2013-08-29 22:14:59,064 WARN [pool-1-thread-1] conf.Configuration(833): hadoop.native.lib is deprecated. Instead, use io.native.lib.available 2013-08-29 22:14:59,316 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(826): Starting up minicluster with 1 master(s) and 2 regionserver(s) and 2 datanode(s) 2013-08-29 22:14:59,339 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(383): Created new mini-cluster data directory: /grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/dfscluster_eba912c1-7f3f-427e-b6d1-13dd8ca70577, deleteOnExit=true 2013-08-29 22:14:59,489 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(613): Setting test.cache.data to /grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/cache_data in system properties and HBase conf 2013-08-29 22:14:59,490 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(613): Setting hadoop.tmp.dir to /grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/hadoop_tmp in system properties and HBase conf 2013-08-29 22:14:59,491 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(613): Setting hadoop.log.dir to /grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/hadoop_logs in system properties and HBase conf 2013-08-29 22:14:59,491 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(613): Setting mapred.local.dir to /grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/mapred_local in system properties and HBase conf 2013-08-29 22:14:59,492 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(613): Setting mapred.temp.dir to /grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/mapred_temp in system properties and HBase conf 2013-08-29 22:14:59,493 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(604): read short circuit is OFF 2013-08-29 22:14:59,651 WARN [pool-1-thread-1] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2013-08-29 22:14:59,863 DEBUG [pool-1-thread-1] fs.HFileSystem(213): The file system is not a DistributedFileSystem. Skipping on block location reordering 2013-08-29 22:14:59,868 WARN [pool-1-thread-1] conf.Configuration(833): mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir 2013-08-29 22:14:59,869 WARN [pool-1-thread-1] conf.Configuration(833): mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir Formatting using clusterid: testClusterID 2013-08-29 22:15:00,046 WARN [pool-1-thread-1] conf.Configuration(833): hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping 2013-08-29 22:15:00,047 WARN [pool-1-thread-1] blockmanagement.DatanodeManager(281): The given interval for marking stale datanode = 30000, which is larger than heartbeat expire interval 20000. 2013-08-29 22:15:02,534 WARN [pool-1-thread-1] impl.MetricsConfig(124): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2013-08-29 22:15:02,682 INFO [pool-1-thread-1] log.Slf4jLog(67): Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2013-08-29 22:15:02,772 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2013-08-29 22:15:02,800 INFO [pool-1-thread-1] log.Slf4jLog(67): Extract jar:file:/homes/hortonzy/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.1.0-beta/hadoop-hdfs-2.1.0-beta-tests.jar!/webapps/hdfs to /grid/0/dev/ty/tmp/Jetty_localhost_43515_hdfs____xs44x0/webapp 2013-08-29 22:15:02,989 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@localhost:43515 2013-08-29 22:15:02,994 WARN [pool-1-thread-1] blockmanagement.DatanodeManager(281): The given interval for marking stale datanode = 30000, which is larger than heartbeat expire interval 20000. 2013-08-29 22:15:03,988 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2013-08-29 22:15:03,994 INFO [pool-1-thread-1] log.Slf4jLog(67): Extract jar:file:/homes/hortonzy/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.1.0-beta/hadoop-hdfs-2.1.0-beta-tests.jar!/webapps/datanode to /grid/0/dev/ty/tmp/Jetty_localhost_58330_datanode____horhys/webapp 2013-08-29 22:15:04,090 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@localhost:58330 2013-08-29 22:15:04,169 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2013-08-29 22:15:04,176 INFO [pool-1-thread-1] log.Slf4jLog(67): Extract jar:file:/homes/hortonzy/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.1.0-beta/hadoop-hdfs-2.1.0-beta-tests.jar!/webapps/datanode to /grid/0/dev/ty/tmp/Jetty_localhost_53262_datanode____6n3zr/webapp 2013-08-29 22:15:04,262 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@localhost:53262 2013-08-29 22:15:05,413 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(1647): BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1793634515-68.142.244.61-55111-1377814504904, infoPort=53262, ipcPort=47953, storageInfo=lv=-47;cid=testClusterID;nsid=516771180;c=0), blocks: 0, processing time: 2 msecs 2013-08-29 22:15:05,436 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(1647): BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-826806964-68.142.244.61-43547-1377814504956, infoPort=58330, ipcPort=56964, storageInfo=lv=-47;cid=testClusterID;nsid=516771180;c=0), blocks: 0, processing time: 0 msecs 2013-08-29 22:15:05,529 WARN [pool-1-thread-1] conf.Configuration(833): fs.default.name is deprecated. Instead, use fs.defaultFS 2013-08-29 22:15:05,611 INFO [pool-1-thread-1] zookeeper.MiniZooKeeperCluster(197): Started MiniZK Cluster and connect 1 ZK server on client port: 61251 2013-08-29 22:15:05,900 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:05,906 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:05,938 DEBUG [pool-1-thread-1] util.FSUtils(639): Created version file at hdfs://localhost:38532/user/hortonzy/hbase with version=8 2013-08-29 22:15:05,997 DEBUG [pool-1-thread-1] client.HConnectionManager(2877): master/kiyo.gq1.ygridcore.net/68.142.244.61:0 HConnection server-to-server retries=350 2013-08-29 22:15:06,192 INFO [pool-1-thread-1] master.HMaster(451): hbase.rootdir=hdfs://localhost:38532/user/hortonzy/hbase, hbase.cluster.distributed=false 2013-08-29 22:15:06,197 WARN [pool-1-thread-1] conf.Configuration(833): mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 2013-08-29 22:15:06,231 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(122): Process identifier=master:44745 connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:07,343 WARN [pool-1-thread-1] zookeeper.RecoverableZooKeeper(258): Possibly transient ZooKeeper, quorum=localhost:61251, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase 2013-08-29 22:15:07,344 INFO [pool-1-thread-1] util.RetryCounter(54): Sleeping 2000ms before retry #1... 2013-08-29 22:15:08,789 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:08,792 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(389): master:44745-0x140cc24e86a0001 connected 2013-08-29 22:15:09,887 WARN [pool-1-thread-1] conf.Configuration(833): dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir 2013-08-29 22:15:09,887 WARN [pool-1-thread-1] conf.Configuration(833): mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir 2013-08-29 22:15:09,887 WARN [pool-1-thread-1] conf.Configuration(833): dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir 2013-08-29 22:15:09,888 WARN [pool-1-thread-1] conf.Configuration(833): fs.default.name is deprecated. Instead, use fs.defaultFS 2013-08-29 22:15:09,888 WARN [pool-1-thread-1] conf.Configuration(833): fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir 2013-08-29 22:15:09,889 WARN [pool-1-thread-1] conf.Configuration(833): dfs.http.address is deprecated. Instead, use dfs.namenode.http-address 2013-08-29 22:15:09,889 WARN [pool-1-thread-1] conf.Configuration(833): heartbeat.recheck.interval is deprecated. Instead, use dfs.namenode.heartbeat.recheck-interval 2013-08-29 22:15:09,890 WARN [pool-1-thread-1] conf.Configuration(833): mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir 2013-08-29 22:15:09,890 WARN [pool-1-thread-1] conf.Configuration(833): dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension 2013-08-29 22:15:09,890 WARN [pool-1-thread-1] conf.Configuration(833): mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir 2013-08-29 22:15:09,891 WARN [pool-1-thread-1] conf.Configuration(833): topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl 2013-08-29 22:15:09,891 WARN [pool-1-thread-1] conf.Configuration(833): dfs.socket.timeout is deprecated. Instead, use dfs.client.socket-timeout 2013-08-29 22:15:09,924 DEBUG [pool-1-thread-1] client.HConnectionManager(2877): regionserver/kiyo.gq1.ygridcore.net/68.142.244.61:0 HConnection server-to-server retries=350 2013-08-29 22:15:10,001 INFO [pool-1-thread-1] hfile.CacheConfig(407): Allocating LruBlockCache with maximum size 675.6 M 2013-08-29 22:15:10,029 WARN [pool-1-thread-1] conf.Configuration(833): fs.default.name is deprecated. Instead, use fs.defaultFS 2013-08-29 22:15:10,032 DEBUG [pool-1-thread-1] client.HConnectionManager(2877): regionserver/kiyo.gq1.ygridcore.net/68.142.244.61:0 HConnection server-to-server retries=350 2013-08-29 22:15:10,049 DEBUG [M:0;kiyo:44745] zookeeper.ZKUtil(433): master:44745-0x140cc24e86a0001 Set watcher on znode that does not yet exist, /hbase/master 2013-08-29 22:15:10,052 DEBUG [M:0;kiyo:44745] zookeeper.ZKUtil(433): master:44745-0x140cc24e86a0001 Set watcher on znode that does not yet exist, /hbase/running 2013-08-29 22:15:10,212 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2013-08-29 22:15:10,216 WARN [M:0;kiyo:44745] hbase.ZNodeClearer(57): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2013-08-29 22:15:10,216 INFO [M:0;kiyo:44745] master.ActiveMasterManager(170): Registered Active Master=kiyo.gq1.ygridcore.net,44745,1377814506185 2013-08-29 22:15:10,219 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:44745-0x140cc24e86a0001 Set watcher on existing znode=/hbase/master 2013-08-29 22:15:10,220 DEBUG [pool-1-thread-1-EventThread] master.ActiveMasterManager(119): A master is now available 2013-08-29 22:15:10,232 INFO [M:0;kiyo:44745] master.SplitLogManager(224): timeout=120000, unassigned timeout=180000 2013-08-29 22:15:10,233 INFO [M:0;kiyo:44745] master.SplitLogManager(233): distributedLogReplay = true 2013-08-29 22:15:10,236 INFO [M:0;kiyo:44745] master.SplitLogManager(1104): Found 0 orphan tasks and 0 rescan nodes 2013-08-29 22:15:10,244 INFO [pool-1-thread-1] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:0;kiyo:51291 2013-08-29 22:15:10,245 INFO [pool-1-thread-1] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:1;kiyo:57016 2013-08-29 22:15:10,251 INFO [RS:0;kiyo:51291] zookeeper.RecoverableZooKeeper(122): Process identifier=regionserver:51291 connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:10,252 INFO [RS:1;kiyo:57016] zookeeper.RecoverableZooKeeper(122): Process identifier=regionserver:57016 connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:10,391 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:51291 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:10,393 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(389): regionserver:51291-0x140cc24e86a0002 connected 2013-08-29 22:15:10,428 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:10,429 DEBUG [RS:0;kiyo:51291] zookeeper.ZKUtil(431): regionserver:51291-0x140cc24e86a0002 Set watcher on existing znode=/hbase/master 2013-08-29 22:15:10,429 DEBUG [RS:1;kiyo:57016] zookeeper.ZKUtil(431): regionserver:57016 Set watcher on existing znode=/hbase/master 2013-08-29 22:15:10,429 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(389): regionserver:57016-0x140cc24e86a0003 connected 2013-08-29 22:15:10,432 DEBUG [RS:0;kiyo:51291] zookeeper.ZKUtil(433): regionserver:51291-0x140cc24e86a0002 Set watcher on znode that does not yet exist, /hbase/running 2013-08-29 22:15:10,432 DEBUG [RS:1;kiyo:57016] zookeeper.ZKUtil(433): regionserver:57016-0x140cc24e86a0003 Set watcher on znode that does not yet exist, /hbase/running 2013-08-29 22:15:10,643 INFO [IPC Server handler 6 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:10,645 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741826_1002 size 42 2013-08-29 22:15:10,738 DEBUG [M:0;kiyo:44745] util.FSUtils(780): Created cluster ID file at hdfs://localhost:38532/user/hortonzy/hbase/hbase.id with ID: 96a4b3bb-b833-4e56-a97b-acefb0cfd757 2013-08-29 22:15:10,766 INFO [M:0;kiyo:44745] master.MasterFileSystem(518): BOOTSTRAP: creating META region 2013-08-29 22:15:10,779 INFO [M:0;kiyo:44745] regionserver.HRegion(3923): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '10', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '8192', ENCODE_ON_DISK => 'true', IN_MEMORY => 'false', BLOCKCACHE => 'false'} RootDir = hdfs://localhost:38532/user/hortonzy/hbase Table name == hbase:meta 2013-08-29 22:15:11,306 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:11,308 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741827_1003 size 30 2013-08-29 22:15:11,431 INFO [M:0;kiyo:44745] wal.FSHLog(353): WAL/HLog configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, optionallogflushinternal=1000ms 2013-08-29 22:15:11,865 INFO [M:0;kiyo:44745] wal.FSHLog(525): New WAL /user/hortonzy/hbase/data/hbase/meta/1588230740/WALs/hlog.1377814511613 2013-08-29 22:15:11,875 DEBUG [M:0;kiyo:44745] regionserver.HRegion(535): Instantiated hbase:meta,,1.1588230740 2013-08-29 22:15:12,175 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:12,183 INFO [StoreOpener-1588230740-1] util.ChecksumType$2(68): Checksum using org.apache.hadoop.util.PureJavaCrc32 2013-08-29 22:15:12,183 INFO [StoreOpener-1588230740-1] util.ChecksumType$3(111): Checksum can use org.apache.hadoop.util.PureJavaCrc32C 2013-08-29 22:15:12,192 INFO [M:0;kiyo:44745] regionserver.HRegion(630): Onlined 1588230740; next sequenceid=1 2013-08-29 22:15:12,192 DEBUG [M:0;kiyo:44745] regionserver.HRegion(950): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2013-08-29 22:15:12,193 DEBUG [M:0;kiyo:44745] regionserver.HRegion(972): Updates disabled for region hbase:meta,,1.1588230740 2013-08-29 22:15:12,194 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(668): Closed info 2013-08-29 22:15:12,195 INFO [M:0;kiyo:44745] regionserver.HRegion(1030): Closed hbase:meta,,1.1588230740 2013-08-29 22:15:12,195 INFO [M:0;kiyo:44745.logSyncer] wal.FSHLog$LogSyncer(976): M:0;kiyo:44745.logSyncer exiting 2013-08-29 22:15:12,195 DEBUG [M:0;kiyo:44745] wal.FSHLog(811): Closing WAL writer in hdfs://localhost:38532/user/hortonzy/hbase/data/hbase/meta/1588230740/WALs 2013-08-29 22:15:12,942 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:12,943 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741828_1004 size 15 2013-08-29 22:15:13,297 DEBUG [M:0;kiyo:44745] wal.FSHLog(771): Moved 1 WAL file(s) to /user/hortonzy/hbase/data/hbase/meta/1588230740/oldWALs 2013-08-29 22:15:13,498 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:13,500 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741829_1005 size 396 2013-08-29 22:15:13,610 DEBUG [M:0;kiyo:44745] util.FSTableDescriptors(633): Wrote descriptor into: hdfs://localhost:38532/user/hortonzy/hbase/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2013-08-29 22:15:13,714 INFO [M:0;kiyo:44745] fs.HFileSystem(244): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2013-08-29 22:15:13,823 INFO [M:0;kiyo:44745] zookeeper.RecoverableZooKeeper(122): Process identifier=hconnection-0x173f7175 connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:13,841 DEBUG [M:0;kiyo:44745-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x173f7175 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:13,842 DEBUG [M:0;kiyo:44745-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x173f7175-0x140cc24e86a0004 connected 2013-08-29 22:15:13,857 DEBUG [M:0;kiyo:44745] catalog.CatalogTracker(192): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@d2a7c1e 2013-08-29 22:15:13,860 DEBUG [M:0;kiyo:44745] zookeeper.ZKUtil(433): master:44745-0x140cc24e86a0001 Set watcher on znode that does not yet exist, /hbase/meta-region-server 2013-08-29 22:15:13,872 DEBUG [M:0;kiyo:44745] zookeeper.ZKUtil(433): master:44745-0x140cc24e86a0001 Set watcher on znode that does not yet exist, /hbase/balancer 2013-08-29 22:15:13,926 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:51291-0x140cc24e86a0002 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2013-08-29 22:15:13,926 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2013-08-29 22:15:13,926 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2013-08-29 22:15:13,932 INFO [M:0;kiyo:44745] master.HMaster(684): Server active/primary master=kiyo.gq1.ygridcore.net,44745,1377814506185, sessionid=0x140cc24e86a0001, setting cluster-up flag (Was=false) 2013-08-29 22:15:13,933 INFO [RS:1;kiyo:57016] zookeeper.RecoverableZooKeeper(122): Process identifier=hconnection-0x6f54c08a connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:13,967 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x6f54c08a Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:13,969 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x6f54c08a-0x140cc24e86a0005 connected 2013-08-29 22:15:14,000 DEBUG [RS:1;kiyo:57016] catalog.CatalogTracker(192): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@55264c84 2013-08-29 22:15:14,004 INFO [RS:0;kiyo:51291] zookeeper.RecoverableZooKeeper(122): Process identifier=hconnection-0x17ef3d12 connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:14,016 DEBUG [RS:1;kiyo:57016] zookeeper.ZKUtil(433): regionserver:57016-0x140cc24e86a0003 Set watcher on znode that does not yet exist, /hbase/meta-region-server 2013-08-29 22:15:14,016 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x17ef3d12 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:14,018 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x17ef3d12-0x140cc24e86a0006 connected 2013-08-29 22:15:14,033 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(707): ClusterId : 96a4b3bb-b833-4e56-a97b-acefb0cfd757 2013-08-29 22:15:14,034 DEBUG [RS:0;kiyo:51291] catalog.CatalogTracker(192): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@75144026 2013-08-29 22:15:14,036 DEBUG [RS:0;kiyo:51291] zookeeper.ZKUtil(433): regionserver:51291-0x140cc24e86a0002 Set watcher on znode that does not yet exist, /hbase/meta-region-server 2013-08-29 22:15:14,053 INFO [M:0;kiyo:44745] procedure.ZKProcedureUtil(258): Clearing all procedure znodes: /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2013-08-29 22:15:14,057 INFO [RS:1;kiyo:57016] zookeeper.RecoverableZooKeeper(518): Node /hbase/online-snapshot/acquired already exists and this is not a retry 2013-08-29 22:15:14,059 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(707): ClusterId : 96a4b3bb-b833-4e56-a97b-acefb0cfd757 2013-08-29 22:15:14,066 DEBUG [M:0;kiyo:44745] procedure.ZKProcedureCoordinatorRpcs(196): Starting the controller for procedure member:kiyo.gq1.ygridcore.net,44745,1377814506185 2013-08-29 22:15:14,066 INFO [RS:0;kiyo:51291] zookeeper.RecoverableZooKeeper(518): Node /hbase/online-snapshot/acquired already exists and this is not a retry 2013-08-29 22:15:14,073 INFO [RS:1;kiyo:57016] regionserver.MemStoreFlusher(119): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2013-08-29 22:15:14,073 INFO [RS:0;kiyo:51291] regionserver.MemStoreFlusher(119): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2013-08-29 22:15:14,080 DEBUG [M:0;kiyo:44745] executor.ExecutorService(99): Starting executor service name=MASTER_OPEN_REGION-kiyo:44745, corePoolSize=5, maxPoolSize=5 2013-08-29 22:15:14,080 DEBUG [M:0;kiyo:44745] executor.ExecutorService(99): Starting executor service name=MASTER_CLOSE_REGION-kiyo:44745, corePoolSize=5, maxPoolSize=5 2013-08-29 22:15:14,080 DEBUG [M:0;kiyo:44745] executor.ExecutorService(99): Starting executor service name=MASTER_SERVER_OPERATIONS-kiyo:44745, corePoolSize=5, maxPoolSize=5 2013-08-29 22:15:14,080 INFO [RS:1;kiyo:57016] regionserver.HRegionServer$CompactionChecker(1325): CompactionChecker runs every 1sec 2013-08-29 22:15:14,081 DEBUG [M:0;kiyo:44745] executor.ExecutorService(99): Starting executor service name=MASTER_META_SERVER_OPERATIONS-kiyo:44745, corePoolSize=5, maxPoolSize=5 2013-08-29 22:15:14,080 INFO [RS:0;kiyo:51291] regionserver.HRegionServer$CompactionChecker(1325): CompactionChecker runs every 1sec 2013-08-29 22:15:14,081 DEBUG [M:0;kiyo:44745] executor.ExecutorService(99): Starting executor service name=M_LOG_REPLAY_OPS-kiyo:44745, corePoolSize=10, maxPoolSize=10 2013-08-29 22:15:14,081 DEBUG [M:0;kiyo:44745] executor.ExecutorService(99): Starting executor service name=MASTER_TABLE_OPERATIONS-kiyo:44745, corePoolSize=1, maxPoolSize=1 2013-08-29 22:15:14,085 DEBUG [M:0;kiyo:44745] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2013-08-29 22:15:14,090 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(1925): reportForDuty to master=kiyo.gq1.ygridcore.net,44745,1377814506185 with port=51291, startcode=1377814509998 2013-08-29 22:15:14,090 DEBUG [M:0;kiyo:44745] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotLogCleaner 2013-08-29 22:15:14,090 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(1925): reportForDuty to master=kiyo.gq1.ygridcore.net,44745,1377814506185 with port=57016, startcode=1377814510039 2013-08-29 22:15:14,094 DEBUG [M:0;kiyo:44745] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2013-08-29 22:15:14,096 DEBUG [M:0;kiyo:44745] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2013-08-29 22:15:14,098 DEBUG [M:0;kiyo:44745] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2013-08-29 22:15:14,098 INFO [M:0;kiyo:44745] master.ServerManager(800): Waiting for region servers count to settle; currently checked in 0, slept for 0 ms, expecting minimum of 2, maximum of 2, timeout of 4500 ms, interval of 1500 ms. 2013-08-29 22:15:14,189 INFO [RpcServer.handler=1,port=44745] master.ServerManager(367): Registering server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:14,189 INFO [RpcServer.handler=0,port=44745] master.ServerManager(367): Registering server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:14,199 INFO [M:0;kiyo:44745] master.ServerManager(817): Finished waiting for region servers count to settle; checked in 2, slept for 101 ms, expecting minimum of 2, maximum of 2, master is running. 2013-08-29 22:15:14,205 DEBUG [RS:0;kiyo:51291] regionserver.HRegionServer(1167): Config from master: hbase.rootdir=hdfs://localhost:38532/user/hortonzy/hbase 2013-08-29 22:15:14,205 DEBUG [RS:1;kiyo:57016] regionserver.HRegionServer(1167): Config from master: hbase.rootdir=hdfs://localhost:38532/user/hortonzy/hbase 2013-08-29 22:15:14,205 DEBUG [RS:0;kiyo:51291] regionserver.HRegionServer(1167): Config from master: fs.default.name=hdfs://localhost:38532 2013-08-29 22:15:14,206 DEBUG [RS:1;kiyo:57016] regionserver.HRegionServer(1167): Config from master: fs.default.name=hdfs://localhost:38532 2013-08-29 22:15:14,216 WARN [RS:1;kiyo:57016] hbase.ZNodeClearer(57): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2013-08-29 22:15:14,216 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2013-08-29 22:15:14,221 INFO [RS:1;kiyo:57016] fs.HFileSystem(244): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2013-08-29 22:15:14,224 WARN [RS:0;kiyo:51291] hbase.ZNodeClearer(57): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2013-08-29 22:15:14,224 DEBUG [RS:1;kiyo:57016] regionserver.HRegionServer(1422): logdir=hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:14,229 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:44745-0x140cc24e86a0001 Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:14,231 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:44745-0x140cc24e86a0001 Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:14,232 INFO [RS:1;kiyo:57016] wal.FSHLog(353): WAL/HLog configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, optionallogflushinternal=1000ms 2013-08-29 22:15:14,234 INFO [RS:0;kiyo:51291] fs.HFileSystem(244): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2013-08-29 22:15:14,238 DEBUG [RS:0;kiyo:51291] regionserver.HRegionServer(1422): logdir=hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:14,245 INFO [RS:0;kiyo:51291] wal.FSHLog(353): WAL/HLog configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, optionallogflushinternal=1000ms 2013-08-29 22:15:14,294 INFO [RS:1;kiyo:57016] wal.FSHLog(525): New WAL /user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,57016,1377814510039/kiyo.gq1.ygridcore.net%2C57016%2C1377814510039.1377814514261 2013-08-29 22:15:14,307 DEBUG [RS:1;kiyo:57016] executor.ExecutorService(99): Starting executor service name=RS_OPEN_REGION-kiyo:57016, corePoolSize=3, maxPoolSize=3 2013-08-29 22:15:14,308 DEBUG [RS:1;kiyo:57016] executor.ExecutorService(99): Starting executor service name=RS_OPEN_META-kiyo:57016, corePoolSize=1, maxPoolSize=1 2013-08-29 22:15:14,308 DEBUG [RS:1;kiyo:57016] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_REGION-kiyo:57016, corePoolSize=3, maxPoolSize=3 2013-08-29 22:15:14,308 DEBUG [RS:1;kiyo:57016] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_META-kiyo:57016, corePoolSize=1, maxPoolSize=1 2013-08-29 22:15:14,310 INFO [RS:0;kiyo:51291] wal.FSHLog(525): New WAL /user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814514277 2013-08-29 22:15:14,313 DEBUG [RS:0;kiyo:51291] executor.ExecutorService(99): Starting executor service name=RS_OPEN_REGION-kiyo:51291, corePoolSize=3, maxPoolSize=3 2013-08-29 22:15:14,313 DEBUG [RS:0;kiyo:51291] executor.ExecutorService(99): Starting executor service name=RS_OPEN_META-kiyo:51291, corePoolSize=1, maxPoolSize=1 2013-08-29 22:15:14,313 DEBUG [RS:0;kiyo:51291] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_REGION-kiyo:51291, corePoolSize=3, maxPoolSize=3 2013-08-29 22:15:14,314 DEBUG [RS:0;kiyo:51291] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_META-kiyo:51291, corePoolSize=1, maxPoolSize=1 2013-08-29 22:15:14,339 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.df.interval is deprecated. Instead, use fs.df.interval 2013-08-29 22:15:14,339 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address 2013-08-29 22:15:14,339 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects 2013-08-29 22:15:14,339 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours 2013-08-29 22:15:14,340 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart 2013-08-29 22:15:14,340 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout 2013-08-29 22:15:14,340 WARN [RS:0;kiyo:51291] conf.Configuration(833): io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent 2013-08-29 22:15:14,340 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies 2013-08-29 22:15:14,340 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication 2013-08-29 22:15:14,340 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill 2013-08-29 22:15:14,341 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second 2013-08-29 22:15:14,341 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress 2013-08-29 22:15:14,340 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.task.profile is deprecated. Instead, use mapreduce.task.profile 2013-08-29 22:15:14,341 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval 2013-08-29 22:15:14,341 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout 2013-08-29 22:15:14,341 WARN [RS:1;kiyo:57016] conf.Configuration(833): jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval 2013-08-29 22:15:14,341 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active 2013-08-29 22:15:14,342 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec 2013-08-29 22:15:14,342 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent 2013-08-29 22:15:14,342 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts 2013-08-29 22:15:14,342 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent 2013-08-29 22:15:14,343 WARN [RS:0;kiyo:51291] conf.Configuration(833): io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor 2013-08-29 22:15:14,342 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels 2013-08-29 22:15:14,343 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation 2013-08-29 22:15:14,343 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb 2013-08-29 22:15:14,343 WARN [RS:0;kiyo:51291] conf.Configuration(833): fs.default.name is deprecated. Instead, use fs.defaultFS 2013-08-29 22:15:14,343 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold 2013-08-29 22:15:14,343 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords 2013-08-29 22:15:14,344 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.block.size is deprecated. Instead, use dfs.blocksize 2013-08-29 22:15:14,344 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision 2013-08-29 22:15:14,344 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size 2013-08-29 22:15:14,344 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours 2013-08-29 22:15:14,344 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count 2013-08-29 22:15:14,344 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent 2013-08-29 22:15:14,345 WARN [RS:1;kiyo:57016] conf.Configuration(833): io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb 2013-08-29 22:15:14,345 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps 2013-08-29 22:15:14,345 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative 2013-08-29 22:15:14,345 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min 2013-08-29 22:15:14,345 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 2013-08-29 22:15:14,345 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize 2013-08-29 22:15:14,346 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir 2013-08-29 22:15:14,346 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad 2013-08-29 22:15:14,346 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver 2013-08-29 22:15:14,346 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval 2013-08-29 22:15:14,346 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval 2013-08-29 22:15:14,346 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker 2013-08-29 22:15:14,347 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize 2013-08-29 22:15:14,347 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir 2013-08-29 22:15:14,347 WARN [RS:1;kiyo:57016] conf.Configuration(833): job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts 2013-08-29 22:15:14,346 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec 2013-08-29 22:15:14,347 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative 2013-08-29 22:15:14,347 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max 2013-08-29 22:15:14,347 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct 2013-08-29 22:15:14,347 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller 2013-08-29 22:15:14,348 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob 2013-08-29 22:15:14,348 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level 2013-08-29 22:15:14,348 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts 2013-08-29 22:15:14,348 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec 2013-08-29 22:15:14,348 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent 2013-08-29 22:15:14,349 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address 2013-08-29 22:15:14,349 WARN [RS:1;kiyo:57016] conf.Configuration(833): keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks 2013-08-29 22:15:14,349 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore 2013-08-29 22:15:14,349 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource 2013-08-29 22:15:14,349 WARN [RS:0;kiyo:51291] conf.Configuration(833): tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads 2013-08-29 22:15:14,349 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold 2013-08-29 22:15:14,349 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address 2013-08-29 22:15:14,350 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address 2013-08-29 22:15:14,350 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled 2013-08-29 22:15:14,350 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists 2013-08-29 22:15:14,350 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb 2013-08-29 22:15:14,350 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts 2013-08-29 22:15:14,350 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum 2013-08-29 22:15:14,351 WARN [RS:1;kiyo:57016] conf.Configuration(833): jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter 2013-08-29 22:15:14,351 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.permissions is deprecated. Instead, use dfs.permissions.enabled 2013-08-29 22:15:14,351 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover 2013-08-29 22:15:14,351 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2013-08-29 22:15:14,351 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap 2013-08-29 22:15:14,351 WARN [RS:0;kiyo:51291] conf.Configuration(833): jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval 2013-08-29 22:15:14,352 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads 2013-08-29 22:15:14,352 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level 2013-08-29 22:15:14,352 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type 2013-08-29 22:15:14,352 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size 2013-08-29 22:15:14,352 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth 2013-08-29 22:15:14,353 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface 2013-08-29 22:15:14,353 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces 2013-08-29 22:15:14,353 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.https.address is deprecated. Instead, use dfs.namenode.https-address 2013-08-29 22:15:14,353 WARN [RS:1;kiyo:57016] conf.Configuration(833): job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval 2013-08-29 22:15:14,353 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size 2013-08-29 22:15:14,353 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir 2013-08-29 22:15:14,354 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval 2013-08-29 22:15:14,354 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 2013-08-29 22:15:14,354 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum 2013-08-29 22:15:14,354 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed 2013-08-29 22:15:14,354 WARN [RS:0;kiyo:51291] conf.Configuration(833): fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir 2013-08-29 22:15:14,355 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename 2013-08-29 22:15:14,355 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size 2013-08-29 22:15:14,355 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler 2013-08-29 22:15:14,355 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups 2013-08-29 22:15:14,355 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup 2013-08-29 22:15:14,355 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address 2013-08-29 22:15:14,355 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout 2013-08-29 22:15:14,356 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation 2013-08-29 22:15:14,356 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks 2013-08-29 22:15:14,356 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold 2013-08-29 22:15:14,356 WARN [RS:1;kiyo:57016] conf.Configuration(833): topology.script.number.args is deprecated. Instead, use net.topology.script.number.args 2013-08-29 22:15:14,356 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps 2013-08-29 22:15:14,357 WARN [RS:1;kiyo:57016] conf.Configuration(833): dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode 2013-08-29 22:15:14,357 WARN [RS:0;kiyo:51291] conf.Configuration(833): dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address 2013-08-29 22:15:14,357 WARN [RS:1;kiyo:57016] conf.Configuration(833): fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period 2013-08-29 22:15:14,357 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill 2013-08-29 22:15:14,358 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress 2013-08-29 22:15:14,358 WARN [RS:0;kiyo:51291] conf.Configuration(833): mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records 2013-08-29 22:15:14,358 WARN [RS:1;kiyo:57016] conf.Configuration(833): mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout 2013-08-29 22:15:14,358 WARN [RS:0;kiyo:51291] conf.Configuration(833): io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum 2013-08-29 22:15:14,362 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(1201): Serving as kiyo.gq1.ygridcore.net,51291,1377814509998, RpcServer on kiyo.gq1.ygridcore.net/68.142.244.61:51291, sessionid=0x140cc24e86a0002 2013-08-29 22:15:14,362 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(171): SplitLogWorker kiyo.gq1.ygridcore.net,57016,1377814510039 starting 2013-08-29 22:15:14,363 DEBUG [RS:0;kiyo:51291] snapshot.RegionServerSnapshotManager(141): Start Snapshot Manager kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:14,362 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(1201): Serving as kiyo.gq1.ygridcore.net,57016,1377814510039, RpcServer on kiyo.gq1.ygridcore.net/68.142.244.61:57016, sessionid=0x140cc24e86a0003 2013-08-29 22:15:14,362 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998] regionserver.SplitLogWorker(171): SplitLogWorker kiyo.gq1.ygridcore.net,51291,1377814509998 starting 2013-08-29 22:15:14,364 DEBUG [RS:1;kiyo:57016] snapshot.RegionServerSnapshotManager(141): Start Snapshot Manager kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:14,363 DEBUG [RS:0;kiyo:51291] procedure.ZKProcedureMemberRpcs(339): Starting procedure member 'kiyo.gq1.ygridcore.net,51291,1377814509998' 2013-08-29 22:15:14,364 DEBUG [RS:1;kiyo:57016] procedure.ZKProcedureMemberRpcs(339): Starting procedure member 'kiyo.gq1.ygridcore.net,57016,1377814510039' 2013-08-29 22:15:14,365 DEBUG [RS:0;kiyo:51291] procedure.ZKProcedureMemberRpcs(138): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2013-08-29 22:15:14,365 DEBUG [RS:1;kiyo:57016] procedure.ZKProcedureMemberRpcs(138): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2013-08-29 22:15:14,367 DEBUG [RS:0;kiyo:51291] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2013-08-29 22:15:14,367 DEBUG [RS:1;kiyo:57016] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2013-08-29 22:15:14,368 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] zookeeper.RecoverableZooKeeper(122): Process identifier=hconnection-0x2a36bb87 connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:14,382 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x2a36bb87 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:14,384 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x2a36bb87-0x140cc24e86a0007 connected 2013-08-29 22:15:14,389 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998] zookeeper.RecoverableZooKeeper(122): Process identifier=hconnection-0x50ba0dfc connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:14,399 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x50ba0dfc Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:14,400 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x50ba0dfc-0x140cc24e86a0008 connected 2013-08-29 22:15:15,267 INFO [M:0;kiyo:44745] zookeeper.MetaRegionTracker(164): Unsetting META region location in ZooKeeper 2013-08-29 22:15:15,290 WARN [M:0;kiyo:44745] zookeeper.RecoverableZooKeeper(168): Node /hbase/meta-region-server already deleted, retry=false 2013-08-29 22:15:15,292 DEBUG [M:0;kiyo:44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for hbase:meta,,1.1588230740 so generated a random one; hri=hbase:meta,,1.1588230740, src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=false 2013-08-29 22:15:15,292 DEBUG [M:0;kiyo:44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 1588230740 with OFFLINE state 2013-08-29 22:15:15,309 DEBUG [M:0;kiyo:44745] master.AssignmentManager(1898): Setting table hbase:meta to ENABLED state. 2013-08-29 22:15:15,340 INFO [M:0;kiyo:44745] master.AssignmentManager(1917): Assigning hbase:meta,,1.1588230740 to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:15,340 INFO [M:0;kiyo:44745] master.RegionStates(263): Transitioned from {1588230740 state=OFFLINE, ts=1377814515292, server=null} to {1588230740 state=PENDING_OPEN, ts=1377814515340, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:15,340 DEBUG [M:0;kiyo:44745] master.ServerManager(735): New admin connection to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:15,370 INFO [RpcServer.handler=0,port=51291] regionserver.HRegionServer(3521): Open hbase:meta,,1.1588230740 2013-08-29 22:15:15,375 DEBUG [RS_OPEN_META-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:15,378 INFO [M:0;kiyo:44745] master.ServerManager(555): AssignmentManager hasn't finished failover cleanup 2013-08-29 22:15:15,389 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2013-08-29 22:15:15,389 DEBUG [RS_OPEN_META-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:15,390 DEBUG [RS_OPEN_META-kiyo:51291-0] regionserver.HRegionServer(1439): logdir=hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:15,392 INFO [RS_OPEN_META-kiyo:51291-0] wal.FSHLog(353): WAL/HLog configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, optionallogflushinternal=1000ms 2013-08-29 22:15:15,392 DEBUG [AM.ZK.Worker-pool2-t1] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=1588230740, current state from region state map ={1588230740 state=PENDING_OPEN, ts=1377814515340, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:15,392 INFO [AM.ZK.Worker-pool2-t1] master.RegionStates(263): Transitioned from {1588230740 state=PENDING_OPEN, ts=1377814515340, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {1588230740 state=OPENING, ts=1377814515392, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:15,417 INFO [RS_OPEN_META-kiyo:51291-0] wal.FSHLog(525): New WAL /user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta 2013-08-29 22:15:15,419 DEBUG [RS_OPEN_META-kiyo:51291-0] regionserver.HRegion(4085): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:15,431 DEBUG [RS_OPEN_META-kiyo:51291-0] coprocessor.CoprocessorHost(181): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2013-08-29 22:15:15,434 DEBUG [RS_OPEN_META-kiyo:51291-0] regionserver.HRegion(5059): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2013-08-29 22:15:15,436 INFO [RS_OPEN_META-kiyo:51291-0] regionserver.RegionCoprocessorHost(196): Load coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2013-08-29 22:15:15,439 DEBUG [RS_OPEN_META-kiyo:51291-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table hbase:meta 1588230740 2013-08-29 22:15:15,440 DEBUG [RS_OPEN_META-kiyo:51291-0] regionserver.HRegion(535): Instantiated hbase:meta,,1.1588230740 2013-08-29 22:15:15,450 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:15,459 INFO [RS_OPEN_META-kiyo:51291-0] regionserver.HRegion(630): Onlined 1588230740; next sequenceid=1 2013-08-29 22:15:15,460 DEBUG [RS_OPEN_META-kiyo:51291-0] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 1588230740 2013-08-29 22:15:15,463 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1691): Post open deploy tasks for region=hbase:meta,,1.1588230740 2013-08-29 22:15:15,463 INFO [PostOpenDeployTasks:1588230740] zookeeper.MetaRegionTracker(123): Setting META region location in ZooKeeper as kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:15,472 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:51291-0x140cc24e86a0002 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2013-08-29 22:15:15,473 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2013-08-29 22:15:15,473 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2013-08-29 22:15:15,477 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1716): Finished post open deploy task for hbase:meta,,1.1588230740 2013-08-29 22:15:15,477 DEBUG [RS_OPEN_META-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:15,489 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2013-08-29 22:15:15,489 DEBUG [RS_OPEN_META-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:15,490 DEBUG [RS_OPEN_META-kiyo:51291-0] handler.OpenRegionHandler(376): Transitioned 1588230740 to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:15,490 DEBUG [RS_OPEN_META-kiyo:51291-0] handler.OpenRegionHandler(186): Opened hbase:meta,,1.1588230740 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:15,491 DEBUG [AM.ZK.Worker-pool2-t2] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=1588230740, current state from region state map ={1588230740 state=OPENING, ts=1377814515392, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:15,491 INFO [AM.ZK.Worker-pool2-t2] master.RegionStates(263): Transitioned from {1588230740 state=OPENING, ts=1377814515392, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {1588230740 state=OPEN, ts=1377814515491, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:15,494 INFO [AM.ZK.Worker-pool2-t2] handler.OpenedRegionHandler(148): Handling OPENED event for 1588230740 from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:15,494 DEBUG [AM.ZK.Worker-pool2-t2] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 1588230740 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:15,505 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2013-08-29 22:15:15,506 DEBUG [AM.ZK.Worker-pool2-t2] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 1588230740 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:15,509 DEBUG [AM.ZK.Worker-pool2-t3] master.AssignmentManager$4(1276): Znode hbase:meta,,1.1588230740 deleted, state: {1588230740 state=OPEN, ts=1377814515491, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:15,509 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates(299): Onlined 1588230740 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:15,511 INFO [M:0;kiyo:44745] master.HMaster(1023): .META. assigned=1, rit=false, location=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:15,579 DEBUG [M:0;kiyo:44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:15,634 DEBUG [M:0;kiyo:44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:15,634 INFO [M:0;kiyo:44745] master.TableNamespaceManager(77): Namespace table not found. Creating... 2013-08-29 22:15:15,751 DEBUG [M:0;kiyo:44745] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/hbase:namespace/write-master:447450000000000 2013-08-29 22:15:15,761 DEBUG [M:0;kiyo:44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:15,781 INFO [MASTER_TABLE_OPERATIONS-kiyo:44745-0] handler.CreateTableHandler(148): Create table hbase:namespace 2013-08-29 22:15:15,856 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:15,858 INFO [IPC Server handler 1 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741830_1006 size 310 2013-08-29 22:15:15,982 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] util.FSTableDescriptors(633): Wrote descriptor into: hdfs://localhost:38532/user/hortonzy/hbase/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2013-08-29 22:15:15,987 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(3923): creating HRegion hbase:namespace HTD == 'hbase:namespace', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '10', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '8192', ENCODE_ON_DISK => 'true', IN_MEMORY => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:38532/user/hortonzy/hbase/.tmp Table name == hbase:namespace 2013-08-29 22:15:16,056 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:16,058 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741831_1007 size 40 2013-08-29 22:15:16,084 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(535): Instantiated hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:16,084 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(950): Closing hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa.: disabling compactions & flushes 2013-08-29 22:15:16,084 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(972): Updates disabled for region hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:16,084 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1030): Closed hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:16,209 INFO [MASTER_TABLE_OPERATIONS-kiyo:44745-0] catalog.MetaEditor(276): Added 1 2013-08-29 22:15:16,211 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] master.AssignmentManager(1557): Assigning 1 region(s) to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:16,213 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] zookeeper.ZKAssign(177): master:44745-0x140cc24e86a0001 Async create of unassigned node d9bcf0514fd39a6c145441a17596cffa with OFFLINE state 2013-08-29 22:15:16,224 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={d9bcf0514fd39a6c145441a17596cffa state=OFFLINE, ts=1377814516210, server=null}, server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:16,226 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={d9bcf0514fd39a6c145441a17596cffa state=OFFLINE, ts=1377814516210, server=null}, server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:16,229 INFO [MASTER_TABLE_OPERATIONS-kiyo:44745-0] master.AssignmentManager(1593): kiyo.gq1.ygridcore.net,51291,1377814509998 unassigned znodes=1 of total=1 2013-08-29 22:15:16,229 INFO [MASTER_TABLE_OPERATIONS-kiyo:44745-0] master.RegionStates(263): Transitioned from {d9bcf0514fd39a6c145441a17596cffa state=OFFLINE, ts=1377814516213, server=null} to {d9bcf0514fd39a6c145441a17596cffa state=PENDING_OPEN, ts=1377814516229, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:16,232 INFO [RpcServer.handler=2,port=51291] regionserver.HRegionServer(3521): Open hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:16,245 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning d9bcf0514fd39a6c145441a17596cffa from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:16,246 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] master.AssignmentManager(1715): Bulk assigning done for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:16,290 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d9bcf0514fd39a6c145441a17596cffa 2013-08-29 22:15:16,290 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node d9bcf0514fd39a6c145441a17596cffa from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:16,291 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(4085): Opening region: {ENCODED => d9bcf0514fd39a6c145441a17596cffa, NAME => 'hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa.', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,292 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table hbase:namespace d9bcf0514fd39a6c145441a17596cffa 2013-08-29 22:15:16,293 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(535): Instantiated hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:16,305 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/hbase:namespace/write-master:447450000000000 2013-08-29 22:15:16,306 DEBUG [AM.ZK.Worker-pool2-t4] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=d9bcf0514fd39a6c145441a17596cffa, current state from region state map ={d9bcf0514fd39a6c145441a17596cffa state=PENDING_OPEN, ts=1377814516229, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:16,306 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates(263): Transitioned from {d9bcf0514fd39a6c145441a17596cffa state=PENDING_OPEN, ts=1377814516229, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {d9bcf0514fd39a6c145441a17596cffa state=OPENING, ts=1377814516306, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:16,325 INFO [StoreOpener-d9bcf0514fd39a6c145441a17596cffa-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:16,334 INFO [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(630): Onlined d9bcf0514fd39a6c145441a17596cffa; next sequenceid=1 2013-08-29 22:15:16,334 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node d9bcf0514fd39a6c145441a17596cffa 2013-08-29 22:15:16,337 INFO [PostOpenDeployTasks:d9bcf0514fd39a6c145441a17596cffa] regionserver.HRegionServer(1691): Post open deploy tasks for region=hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:16,351 INFO [PostOpenDeployTasks:d9bcf0514fd39a6c145441a17596cffa] catalog.MetaEditor(462): Updated row hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:16,351 INFO [PostOpenDeployTasks:d9bcf0514fd39a6c145441a17596cffa] regionserver.HRegionServer(1716): Finished post open deploy task for hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:16,352 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning d9bcf0514fd39a6c145441a17596cffa from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:16,363 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d9bcf0514fd39a6c145441a17596cffa 2013-08-29 22:15:16,363 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node d9bcf0514fd39a6c145441a17596cffa from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:16,364 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(376): Transitioned d9bcf0514fd39a6c145441a17596cffa to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:16,364 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(186): Opened hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:16,365 DEBUG [AM.ZK.Worker-pool2-t5] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=d9bcf0514fd39a6c145441a17596cffa, current state from region state map ={d9bcf0514fd39a6c145441a17596cffa state=OPENING, ts=1377814516306, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:16,366 INFO [AM.ZK.Worker-pool2-t5] master.RegionStates(263): Transitioned from {d9bcf0514fd39a6c145441a17596cffa state=OPENING, ts=1377814516306, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {d9bcf0514fd39a6c145441a17596cffa state=OPEN, ts=1377814516366, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:16,366 DEBUG [AM.ZK.Worker-pool2-t5] handler.OpenedRegionHandler(150): Handling OPENED event for d9bcf0514fd39a6c145441a17596cffa from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:16,366 DEBUG [AM.ZK.Worker-pool2-t5] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node d9bcf0514fd39a6c145441a17596cffa in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:16,394 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/d9bcf0514fd39a6c145441a17596cffa 2013-08-29 22:15:16,395 DEBUG [AM.ZK.Worker-pool2-t5] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node d9bcf0514fd39a6c145441a17596cffa in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:16,396 DEBUG [AM.ZK.Worker-pool2-t6] master.AssignmentManager$4(1276): Znode hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. deleted, state: {d9bcf0514fd39a6c145441a17596cffa state=OPEN, ts=1377814516366, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:16,396 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates(299): Onlined d9bcf0514fd39a6c145441a17596cffa on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:16,524 DEBUG [M:0;kiyo:44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,528 DEBUG [M:0;kiyo:44745] zookeeper.ZKUtil(433): master:44745-0x140cc24e86a0001 Set watcher on znode that does not yet exist, /hbase/namespace 2013-08-29 22:15:16,546 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2013-08-29 22:15:16,646 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2013-08-29 22:15:16,665 DEBUG [pool-1-thread-1-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node default with data: \x0A\x07default 2013-08-29 22:15:16,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2013-08-29 22:15:16,698 DEBUG [pool-1-thread-1-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node default with data: \x0A\x07default 2013-08-29 22:15:16,699 DEBUG [pool-1-thread-1-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node hbase with data: \x0A\x05hbase 2013-08-29 22:15:16,701 DEBUG [M:0;kiyo:44745] client.ClientScanner(218): Finished {ENCODED => d9bcf0514fd39a6c145441a17596cffa, NAME => 'hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa.', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,713 INFO [M:0;kiyo:44745] zookeeper.RecoverableZooKeeper(518): Node /hbase/namespace/default already exists and this is not a retry 2013-08-29 22:15:16,721 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2013-08-29 22:15:16,738 INFO [M:0;kiyo:44745] zookeeper.RecoverableZooKeeper(518): Node /hbase/namespace/hbase already exists and this is not a retry 2013-08-29 22:15:16,746 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2013-08-29 22:15:16,755 DEBUG [M:0;kiyo:44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,756 INFO [M:0;kiyo:44745] catalog.MetaMigrationConvertingToPB(132): META already up-to date with PB serialization 2013-08-29 22:15:16,775 DEBUG [M:0;kiyo:44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,778 INFO [M:0;kiyo:44745] master.AssignmentManager(481): Clean cluster startup. Assigning userregions 2013-08-29 22:15:16,778 DEBUG [M:0;kiyo:44745] zookeeper.ZKAssign(452): master:44745-0x140cc24e86a0001 Deleting any existing unassigned nodes 2013-08-29 22:15:16,794 INFO [M:0;kiyo:44745] master.SnapshotOfRegionAssignmentFromMeta(95): Start to scan the META for the current region assignment snappshot 2013-08-29 22:15:16,802 DEBUG [M:0;kiyo:44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,804 INFO [M:0;kiyo:44745] master.SnapshotOfRegionAssignmentFromMeta(138): Finished to scan the META for the current region assignmentsnapshot 2013-08-29 22:15:16,816 INFO [M:0;kiyo:44745] master.HMaster(914): Master has completed initialization 2013-08-29 22:15:16,823 DEBUG [NamespaceJanitor-kiyo:44745] client.ClientScanner(218): Finished {ENCODED => d9bcf0514fd39a6c145441a17596cffa, NAME => 'hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa.', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,857 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(122): Process identifier=hconnection-0x4e0fd2b1 connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:16,864 DEBUG [CatalogJanitor-kiyo:44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,871 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x4e0fd2b1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:16,873 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x4e0fd2b1-0x140cc24e86a0009 connected 2013-08-29 22:15:16,882 DEBUG [pool-1-thread-1] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:16,883 INFO [pool-1-thread-1] client.HConnectionManager$HConnectionImplementation(1926): Closing zookeeper sessionid=0x140cc24e86a0009 2013-08-29 22:15:16,903 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(122): Process identifier=hconnection-0x72213339 connecting to ZooKeeper ensemble=localhost:61251 2013-08-29 22:15:16,913 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x72213339 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:16,914 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x72213339-0x140cc24e86a000a connected 2013-08-29 22:15:16,916 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(896): Minicluster is up 2013-08-29 22:15:16,973 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: TestFullLogReconstruction#testReconstruction Thread=243, OpenFileDescriptor=418, MaxFileDescriptor=32768, SystemLoadAverage=504, ProcessCount=502, AvailableMemoryMB=4820, ConnectionCount=6 2013-08-29 22:15:17,000 INFO [RpcServer.handler=4,port=44745] master.HMaster(1817): Client=hortonzy//68.142.244.61 create 'tabletest', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'} 2013-08-29 22:15:17,033 DEBUG [RpcServer.handler=4,port=44745] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/tabletest/write-master:447450000000000 2013-08-29 22:15:17,041 DEBUG [RpcServer.handler=4,port=44745] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,063 INFO [MASTER_TABLE_OPERATIONS-kiyo:44745-0] handler.CreateTableHandler(148): Create table tabletest 2013-08-29 22:15:17,074 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,106 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:17,106 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:17,156 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] util.FSTableDescriptors(633): Wrote descriptor into: hdfs://localhost:38532/user/hortonzy/hbase/.tmp/data/default/tabletest/.tabledesc/.tableinfo.0000000001 2013-08-29 22:15:17,159 INFO [RegionOpenAndInitThread-tabletest-1] regionserver.HRegion(3923): creating HRegion tabletest HTD == 'tabletest', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:38532/user/hortonzy/hbase/.tmp Table name == tabletest 2013-08-29 22:15:17,180 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,199 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:17,200 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:17,214 DEBUG [RegionOpenAndInitThread-tabletest-1] regionserver.HRegion(535): Instantiated tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:17,215 DEBUG [RegionOpenAndInitThread-tabletest-1] regionserver.HRegion(950): Closing tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639.: disabling compactions & flushes 2013-08-29 22:15:17,215 DEBUG [RegionOpenAndInitThread-tabletest-1] regionserver.HRegion(972): Updates disabled for region tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:17,215 INFO [RegionOpenAndInitThread-tabletest-1] regionserver.HRegion(1030): Closed tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:17,235 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager(645): Garbage collecting all recovering regions. 2013-08-29 22:15:17,240 INFO [MASTER_TABLE_OPERATIONS-kiyo:44745-0] catalog.MetaEditor(276): Added 1 2013-08-29 22:15:17,240 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] master.AssignmentManager(1557): Assigning 1 region(s) to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,240 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] zookeeper.ZKAssign(177): master:44745-0x140cc24e86a0001 Async create of unassigned node aec47101ea5cc382f708256b11a18639 with OFFLINE state 2013-08-29 22:15:17,245 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,246 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={aec47101ea5cc382f708256b11a18639 state=OFFLINE, ts=1377814517240, server=null}, server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,248 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={aec47101ea5cc382f708256b11a18639 state=OFFLINE, ts=1377814517240, server=null}, server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,251 INFO [MASTER_TABLE_OPERATIONS-kiyo:44745-0] master.AssignmentManager(1593): kiyo.gq1.ygridcore.net,51291,1377814509998 unassigned znodes=1 of total=1 2013-08-29 22:15:17,251 INFO [MASTER_TABLE_OPERATIONS-kiyo:44745-0] master.RegionStates(263): Transitioned from {aec47101ea5cc382f708256b11a18639 state=OFFLINE, ts=1377814517240, server=null} to {aec47101ea5cc382f708256b11a18639 state=PENDING_OPEN, ts=1377814517251, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,252 INFO [RpcServer.handler=4,port=51291] regionserver.HRegionServer(3521): Open tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:17,268 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning aec47101ea5cc382f708256b11a18639 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,269 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] master.AssignmentManager(1715): Bulk assigning done for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,287 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/aec47101ea5cc382f708256b11a18639 2013-08-29 22:15:17,288 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node aec47101ea5cc382f708256b11a18639 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,288 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(4085): Opening region: {ENCODED => aec47101ea5cc382f708256b11a18639, NAME => 'tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639.', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,289 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest aec47101ea5cc382f708256b11a18639 2013-08-29 22:15:17,289 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(535): Instantiated tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:17,290 DEBUG [AM.ZK.Worker-pool2-t8] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=aec47101ea5cc382f708256b11a18639, current state from region state map ={aec47101ea5cc382f708256b11a18639 state=PENDING_OPEN, ts=1377814517251, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,290 INFO [AM.ZK.Worker-pool2-t8] master.RegionStates(263): Transitioned from {aec47101ea5cc382f708256b11a18639 state=PENDING_OPEN, ts=1377814517251, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {aec47101ea5cc382f708256b11a18639 state=OPENING, ts=1377814517290, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,295 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:44745-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/tabletest/write-master:447450000000000 2013-08-29 22:15:17,315 INFO [StoreOpener-aec47101ea5cc382f708256b11a18639-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:17,321 INFO [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(630): Onlined aec47101ea5cc382f708256b11a18639; next sequenceid=1 2013-08-29 22:15:17,321 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node aec47101ea5cc382f708256b11a18639 2013-08-29 22:15:17,323 INFO [PostOpenDeployTasks:aec47101ea5cc382f708256b11a18639] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:17,331 INFO [PostOpenDeployTasks:aec47101ea5cc382f708256b11a18639] catalog.MetaEditor(462): Updated row tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,331 INFO [PostOpenDeployTasks:aec47101ea5cc382f708256b11a18639] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:17,331 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning aec47101ea5cc382f708256b11a18639 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:17,367 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/aec47101ea5cc382f708256b11a18639 2013-08-29 22:15:17,367 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node aec47101ea5cc382f708256b11a18639 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:17,367 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(376): Transitioned aec47101ea5cc382f708256b11a18639 to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,367 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(186): Opened tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,369 DEBUG [AM.ZK.Worker-pool2-t9] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=aec47101ea5cc382f708256b11a18639, current state from region state map ={aec47101ea5cc382f708256b11a18639 state=OPENING, ts=1377814517290, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,369 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates(263): Transitioned from {aec47101ea5cc382f708256b11a18639 state=OPENING, ts=1377814517290, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {aec47101ea5cc382f708256b11a18639 state=OPEN, ts=1377814517369, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,369 DEBUG [AM.ZK.Worker-pool2-t9] handler.OpenedRegionHandler(150): Handling OPENED event for aec47101ea5cc382f708256b11a18639 from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:17,369 DEBUG [AM.ZK.Worker-pool2-t9] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node aec47101ea5cc382f708256b11a18639 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:17,387 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/aec47101ea5cc382f708256b11a18639 2013-08-29 22:15:17,387 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,388 DEBUG [AM.ZK.Worker-pool2-t9] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node aec47101ea5cc382f708256b11a18639 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:17,388 DEBUG [AM.ZK.Worker-pool2-t11] master.AssignmentManager$4(1276): Znode tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. deleted, state: {aec47101ea5cc382f708256b11a18639 state=OPEN, ts=1377814517369, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,388 INFO [AM.ZK.Worker-pool2-t11] master.RegionStates(299): Onlined aec47101ea5cc382f708256b11a18639 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,393 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,399 INFO [Thread-221] hbase.Waiter(174): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2013-08-29 22:15:17,404 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,417 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,453 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,453 INFO [Thread-221] hbase.HBaseTestingUtility(1919): getMetaTableRows: row -> tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639.{ENCODED => aec47101ea5cc382f708256b11a18639, NAME => 'tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639.', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:17,459 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:15:17,464 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:15:17,469 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:17,473 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:17,478 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:17,482 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:15:17,487 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:15:17,492 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:17,496 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:17,501 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:17,506 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:17,511 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:17,516 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:17,521 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:15:17,527 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:15:17,533 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:15:17,539 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:15:17,543 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:15:17,548 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:15:17,552 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:17,556 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:15:17,561 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:17,566 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:15:17,570 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:17,575 DEBUG [Thread-221] catalog.MetaEditor(236): Added tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:17,575 INFO [Thread-221] hbase.HBaseTestingUtility(1826): createMultiRegions: deleting meta row -> tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:17,601 INFO [RpcServer.handler=1,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:15:17,601 DEBUG [RpcServer.handler=1,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. so generated a random one; hri=tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:17,601 DEBUG [RpcServer.handler=1,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node a9f08b5289c0817bc15b68dd39ca295a with OFFLINE state 2013-08-29 22:15:17,612 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,613 INFO [RpcServer.handler=1,port=44745] master.AssignmentManager(1917): Assigning tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:17,614 INFO [RpcServer.handler=1,port=44745] master.RegionStates(263): Transitioned from {a9f08b5289c0817bc15b68dd39ca295a state=OFFLINE, ts=1377814517601, server=null} to {a9f08b5289c0817bc15b68dd39ca295a state=PENDING_OPEN, ts=1377814517614, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,614 DEBUG [RpcServer.handler=1,port=44745] master.ServerManager(735): New admin connection to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:17,616 INFO [RpcServer.handler=0,port=57016] regionserver.HRegionServer(3521): Open tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:15:17,625 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning a9f08b5289c0817bc15b68dd39ca295a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,637 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a9f08b5289c0817bc15b68dd39ca295a 2013-08-29 22:15:17,637 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node a9f08b5289c0817bc15b68dd39ca295a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,637 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(4085): Opening region: {ENCODED => a9f08b5289c0817bc15b68dd39ca295a, NAME => 'tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a.', STARTKEY => '', ENDKEY => 'bbb'} 2013-08-29 22:15:17,638 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest a9f08b5289c0817bc15b68dd39ca295a 2013-08-29 22:15:17,638 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(535): Instantiated tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:15:17,639 DEBUG [AM.ZK.Worker-pool2-t13] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=a9f08b5289c0817bc15b68dd39ca295a, current state from region state map ={a9f08b5289c0817bc15b68dd39ca295a state=PENDING_OPEN, ts=1377814517614, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,640 INFO [AM.ZK.Worker-pool2-t13] master.RegionStates(263): Transitioned from {a9f08b5289c0817bc15b68dd39ca295a state=PENDING_OPEN, ts=1377814517614, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {a9f08b5289c0817bc15b68dd39ca295a state=OPENING, ts=1377814517640, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,640 INFO [RpcServer.handler=3,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:15:17,640 DEBUG [RpcServer.handler=3,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. so generated a random one; hri=tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:17,640 DEBUG [RpcServer.handler=3,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node e16cb91aec0ea3dd068fbaf236ee81fa with OFFLINE state 2013-08-29 22:15:17,641 WARN [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: a9f08b5289c0817bc15b68dd39ca295a 2013-08-29 22:15:17,653 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,655 INFO [RpcServer.handler=3,port=44745] master.AssignmentManager(1917): Assigning tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:17,655 INFO [RpcServer.handler=3,port=44745] master.RegionStates(263): Transitioned from {e16cb91aec0ea3dd068fbaf236ee81fa state=OFFLINE, ts=1377814517640, server=null} to {e16cb91aec0ea3dd068fbaf236ee81fa state=PENDING_OPEN, ts=1377814517655, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,656 INFO [RpcServer.handler=1,port=57016] regionserver.HRegionServer(3521): Open tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:15:17,676 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning e16cb91aec0ea3dd068fbaf236ee81fa from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,688 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:17,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e16cb91aec0ea3dd068fbaf236ee81fa 2013-08-29 22:15:17,688 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node e16cb91aec0ea3dd068fbaf236ee81fa from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,689 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(4085): Opening region: {ENCODED => e16cb91aec0ea3dd068fbaf236ee81fa, NAME => 'tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2013-08-29 22:15:17,689 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741836_1012 size 45 2013-08-29 22:15:17,690 DEBUG [AM.ZK.Worker-pool2-t15] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=e16cb91aec0ea3dd068fbaf236ee81fa, current state from region state map ={e16cb91aec0ea3dd068fbaf236ee81fa state=PENDING_OPEN, ts=1377814517655, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,690 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest e16cb91aec0ea3dd068fbaf236ee81fa 2013-08-29 22:15:17,691 INFO [AM.ZK.Worker-pool2-t15] master.RegionStates(263): Transitioned from {e16cb91aec0ea3dd068fbaf236ee81fa state=PENDING_OPEN, ts=1377814517655, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {e16cb91aec0ea3dd068fbaf236ee81fa state=OPENING, ts=1377814517691, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,691 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(535): Instantiated tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:15:17,693 INFO [RpcServer.handler=4,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:17,693 DEBUG [RpcServer.handler=4,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. so generated a random one; hri=tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:17,693 DEBUG [RpcServer.handler=4,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 850bc9f74b9620f114115790531a78ae with OFFLINE state 2013-08-29 22:15:17,706 WARN [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: e16cb91aec0ea3dd068fbaf236ee81fa 2013-08-29 22:15:17,712 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,713 INFO [RpcServer.handler=4,port=44745] master.AssignmentManager(1917): Assigning tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,713 INFO [RpcServer.handler=4,port=44745] master.RegionStates(263): Transitioned from {850bc9f74b9620f114115790531a78ae state=OFFLINE, ts=1377814517693, server=null} to {850bc9f74b9620f114115790531a78ae state=PENDING_OPEN, ts=1377814517713, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,715 INFO [RpcServer.handler=3,port=51291] regionserver.HRegionServer(3521): Open tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:17,719 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 850bc9f74b9620f114115790531a78ae from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,737 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/850bc9f74b9620f114115790531a78ae 2013-08-29 22:15:17,737 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 850bc9f74b9620f114115790531a78ae from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,738 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(4085): Opening region: {ENCODED => 850bc9f74b9620f114115790531a78ae, NAME => 'tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2013-08-29 22:15:17,739 DEBUG [AM.ZK.Worker-pool2-t17] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=850bc9f74b9620f114115790531a78ae, current state from region state map ={850bc9f74b9620f114115790531a78ae state=PENDING_OPEN, ts=1377814517713, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,739 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 850bc9f74b9620f114115790531a78ae 2013-08-29 22:15:17,739 INFO [AM.ZK.Worker-pool2-t17] master.RegionStates(263): Transitioned from {850bc9f74b9620f114115790531a78ae state=PENDING_OPEN, ts=1377814517713, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {850bc9f74b9620f114115790531a78ae state=OPENING, ts=1377814517739, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,740 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(535): Instantiated tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:17,741 INFO [RpcServer.handler=0,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:17,741 DEBUG [RpcServer.handler=0,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. so generated a random one; hri=tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:17,741 DEBUG [RpcServer.handler=0,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 013bc94b13efec611d74c9d002c0f201 with OFFLINE state 2013-08-29 22:15:17,741 WARN [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 850bc9f74b9620f114115790531a78ae 2013-08-29 22:15:17,755 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,757 INFO [RpcServer.handler=0,port=44745] master.AssignmentManager(1917): Assigning tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,758 INFO [RpcServer.handler=0,port=44745] master.RegionStates(263): Transitioned from {013bc94b13efec611d74c9d002c0f201 state=OFFLINE, ts=1377814517741, server=null} to {013bc94b13efec611d74c9d002c0f201 state=PENDING_OPEN, ts=1377814517758, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,759 INFO [RpcServer.handler=4,port=51291] regionserver.HRegionServer(3521): Open tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:17,775 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 013bc94b13efec611d74c9d002c0f201 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,785 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:17,786 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:17,799 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:17,799 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:17,803 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/013bc94b13efec611d74c9d002c0f201 2013-08-29 22:15:17,803 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 013bc94b13efec611d74c9d002c0f201 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,804 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(4085): Opening region: {ENCODED => 013bc94b13efec611d74c9d002c0f201, NAME => 'tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2013-08-29 22:15:17,804 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 013bc94b13efec611d74c9d002c0f201 2013-08-29 22:15:17,805 DEBUG [AM.ZK.Worker-pool2-t19] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=013bc94b13efec611d74c9d002c0f201, current state from region state map ={013bc94b13efec611d74c9d002c0f201 state=PENDING_OPEN, ts=1377814517758, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,805 INFO [AM.ZK.Worker-pool2-t19] master.RegionStates(263): Transitioned from {013bc94b13efec611d74c9d002c0f201 state=PENDING_OPEN, ts=1377814517758, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {013bc94b13efec611d74c9d002c0f201 state=OPENING, ts=1377814517805, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,805 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(535): Instantiated tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:17,808 INFO [RpcServer.handler=2,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:17,808 DEBUG [RpcServer.handler=2,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. so generated a random one; hri=tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:17,808 DEBUG [RpcServer.handler=2,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 411506c2261eadd186d247f40f8b53d0 with OFFLINE state 2013-08-29 22:15:17,814 WARN [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 013bc94b13efec611d74c9d002c0f201 2013-08-29 22:15:17,828 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,830 INFO [RpcServer.handler=2,port=44745] master.AssignmentManager(1917): Assigning tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:17,831 INFO [RpcServer.handler=2,port=44745] master.RegionStates(263): Transitioned from {411506c2261eadd186d247f40f8b53d0 state=OFFLINE, ts=1377814517808, server=null} to {411506c2261eadd186d247f40f8b53d0 state=PENDING_OPEN, ts=1377814517831, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,832 INFO [RpcServer.handler=0,port=51291] regionserver.HRegionServer(3521): Open tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:17,840 INFO [StoreOpener-a9f08b5289c0817bc15b68dd39ca295a-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:17,848 INFO [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(630): Onlined a9f08b5289c0817bc15b68dd39ca295a; next sequenceid=1 2013-08-29 22:15:17,849 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node a9f08b5289c0817bc15b68dd39ca295a 2013-08-29 22:15:17,851 INFO [PostOpenDeployTasks:a9f08b5289c0817bc15b68dd39ca295a] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:15:17,862 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 411506c2261eadd186d247f40f8b53d0 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,863 INFO [PostOpenDeployTasks:a9f08b5289c0817bc15b68dd39ca295a] catalog.MetaEditor(462): Updated row tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:17,863 INFO [PostOpenDeployTasks:a9f08b5289c0817bc15b68dd39ca295a] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:15:17,864 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning a9f08b5289c0817bc15b68dd39ca295a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:17,880 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/411506c2261eadd186d247f40f8b53d0 2013-08-29 22:15:17,881 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 411506c2261eadd186d247f40f8b53d0 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,881 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(4085): Opening region: {ENCODED => 411506c2261eadd186d247f40f8b53d0, NAME => 'tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0.', STARTKEY => 'eee', ENDKEY => 'fff'} 2013-08-29 22:15:17,882 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 411506c2261eadd186d247f40f8b53d0 2013-08-29 22:15:17,883 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(535): Instantiated tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:17,884 DEBUG [AM.ZK.Worker-pool2-t1] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=411506c2261eadd186d247f40f8b53d0, current state from region state map ={411506c2261eadd186d247f40f8b53d0 state=PENDING_OPEN, ts=1377814517831, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,884 INFO [AM.ZK.Worker-pool2-t1] master.RegionStates(263): Transitioned from {411506c2261eadd186d247f40f8b53d0 state=PENDING_OPEN, ts=1377814517831, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {411506c2261eadd186d247f40f8b53d0 state=OPENING, ts=1377814517884, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:17,885 WARN [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 411506c2261eadd186d247f40f8b53d0 2013-08-29 22:15:17,886 INFO [RpcServer.handler=1,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:15:17,886 DEBUG [RpcServer.handler=1,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. so generated a random one; hri=tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:17,886 DEBUG [RpcServer.handler=1,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 9726b1bb649d384a3531183536e758f2 with OFFLINE state 2013-08-29 22:15:17,893 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:17,895 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741839_1015 size 48 2013-08-29 22:15:17,906 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a9f08b5289c0817bc15b68dd39ca295a 2013-08-29 22:15:17,906 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node a9f08b5289c0817bc15b68dd39ca295a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:17,906 DEBUG [RS_OPEN_REGION-kiyo:57016-0] handler.OpenRegionHandler(376): Transitioned a9f08b5289c0817bc15b68dd39ca295a to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:17,906 DEBUG [RS_OPEN_REGION-kiyo:57016-0] handler.OpenRegionHandler(186): Opened tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:17,908 DEBUG [AM.ZK.Worker-pool2-t2] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=a9f08b5289c0817bc15b68dd39ca295a, current state from region state map ={a9f08b5289c0817bc15b68dd39ca295a state=OPENING, ts=1377814517640, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,908 INFO [AM.ZK.Worker-pool2-t2] master.RegionStates(263): Transitioned from {a9f08b5289c0817bc15b68dd39ca295a state=OPENING, ts=1377814517640, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {a9f08b5289c0817bc15b68dd39ca295a state=OPEN, ts=1377814517908, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,908 DEBUG [AM.ZK.Worker-pool2-t2] handler.OpenedRegionHandler(150): Handling OPENED event for a9f08b5289c0817bc15b68dd39ca295a from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:17,908 DEBUG [AM.ZK.Worker-pool2-t2] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node a9f08b5289c0817bc15b68dd39ca295a in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:17,931 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,933 INFO [RpcServer.handler=1,port=44745] master.AssignmentManager(1917): Assigning tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:17,933 INFO [RpcServer.handler=1,port=44745] master.RegionStates(263): Transitioned from {9726b1bb649d384a3531183536e758f2 state=OFFLINE, ts=1377814517886, server=null} to {9726b1bb649d384a3531183536e758f2 state=PENDING_OPEN, ts=1377814517933, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,934 INFO [RpcServer.handler=2,port=57016] regionserver.HRegionServer(3521): Open tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:15:17,947 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/a9f08b5289c0817bc15b68dd39ca295a 2013-08-29 22:15:17,948 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:17,948 DEBUG [AM.ZK.Worker-pool2-t2] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node a9f08b5289c0817bc15b68dd39ca295a in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:17,949 DEBUG [AM.ZK.Worker-pool2-t2] master.AssignmentManager$4(1276): Znode tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. deleted, state: {a9f08b5289c0817bc15b68dd39ca295a state=OPEN, ts=1377814517908, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,949 INFO [AM.ZK.Worker-pool2-t2] master.RegionStates(299): Onlined a9f08b5289c0817bc15b68dd39ca295a on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:17,956 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 9726b1bb649d384a3531183536e758f2 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,958 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:17,959 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:17,960 INFO [StoreOpener-850bc9f74b9620f114115790531a78ae-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:17,981 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/9726b1bb649d384a3531183536e758f2 2013-08-29 22:15:17,982 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 9726b1bb649d384a3531183536e758f2 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:17,982 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(4085): Opening region: {ENCODED => 9726b1bb649d384a3531183536e758f2, NAME => 'tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2013-08-29 22:15:17,983 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 9726b1bb649d384a3531183536e758f2 2013-08-29 22:15:17,983 DEBUG [AM.ZK.Worker-pool2-t6] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=9726b1bb649d384a3531183536e758f2, current state from region state map ={9726b1bb649d384a3531183536e758f2 state=PENDING_OPEN, ts=1377814517933, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,984 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(535): Instantiated tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:15:17,984 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates(263): Transitioned from {9726b1bb649d384a3531183536e758f2 state=PENDING_OPEN, ts=1377814517933, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {9726b1bb649d384a3531183536e758f2 state=OPENING, ts=1377814517984, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:17,984 INFO [RpcServer.handler=3,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:15:17,984 DEBUG [RpcServer.handler=3,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. so generated a random one; hri=tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:17,985 DEBUG [RpcServer.handler=3,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 11a9c621d13d5b11ed27a0104fdd0798 with OFFLINE state 2013-08-29 22:15:18,006 INFO [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(630): Onlined 850bc9f74b9620f114115790531a78ae; next sequenceid=1 2013-08-29 22:15:18,006 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 850bc9f74b9620f114115790531a78ae 2013-08-29 22:15:18,024 WARN [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 9726b1bb649d384a3531183536e758f2 2013-08-29 22:15:19,238 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:19,241 INFO [PostOpenDeployTasks:850bc9f74b9620f114115790531a78ae] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:19,242 INFO [RpcServer.handler=3,port=44745] master.AssignmentManager(1917): Assigning tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:19,242 INFO [RpcServer.handler=3,port=44745] master.RegionStates(263): Transitioned from {11a9c621d13d5b11ed27a0104fdd0798 state=OFFLINE, ts=1377814517984, server=null} to {11a9c621d13d5b11ed27a0104fdd0798 state=PENDING_OPEN, ts=1377814519242, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:19,243 INFO [RpcServer.handler=3,port=57016] regionserver.HRegionServer(3521): Open tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:15:19,249 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 11a9c621d13d5b11ed27a0104fdd0798 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:19,251 INFO [PostOpenDeployTasks:850bc9f74b9620f114115790531a78ae] catalog.MetaEditor(462): Updated row tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:19,251 INFO [PostOpenDeployTasks:850bc9f74b9620f114115790531a78ae] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:19,251 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 850bc9f74b9620f114115790531a78ae from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:19,285 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/11a9c621d13d5b11ed27a0104fdd0798 2013-08-29 22:15:19,285 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 11a9c621d13d5b11ed27a0104fdd0798 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:19,286 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(4085): Opening region: {ENCODED => 11a9c621d13d5b11ed27a0104fdd0798, NAME => 'tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2013-08-29 22:15:19,286 INFO [StoreOpener-e16cb91aec0ea3dd068fbaf236ee81fa-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:19,287 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 11a9c621d13d5b11ed27a0104fdd0798 2013-08-29 22:15:19,287 DEBUG [AM.ZK.Worker-pool2-t8] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=11a9c621d13d5b11ed27a0104fdd0798, current state from region state map ={11a9c621d13d5b11ed27a0104fdd0798 state=PENDING_OPEN, ts=1377814519242, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:19,287 INFO [AM.ZK.Worker-pool2-t8] master.RegionStates(263): Transitioned from {11a9c621d13d5b11ed27a0104fdd0798 state=PENDING_OPEN, ts=1377814519242, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {11a9c621d13d5b11ed27a0104fdd0798 state=OPENING, ts=1377814519287, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:19,288 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(535): Instantiated tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:15:19,289 WARN [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 11a9c621d13d5b11ed27a0104fdd0798 2013-08-29 22:15:19,291 INFO [RpcServer.handler=0,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:19,291 DEBUG [RpcServer.handler=0,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. so generated a random one; hri=tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:19,291 DEBUG [RpcServer.handler=0,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 632b714a3ec4d729e14be6daae99619a with OFFLINE state 2013-08-29 22:15:19,330 INFO [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(630): Onlined e16cb91aec0ea3dd068fbaf236ee81fa; next sequenceid=1 2013-08-29 22:15:19,331 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node e16cb91aec0ea3dd068fbaf236ee81fa 2013-08-29 22:15:19,472 INFO [IPC Server handler 6 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:19,475 INFO [IPC Server handler 1 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:19,568 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/850bc9f74b9620f114115790531a78ae 2013-08-29 22:15:19,569 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 850bc9f74b9620f114115790531a78ae from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:19,569 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(376): Transitioned 850bc9f74b9620f114115790531a78ae to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:19,569 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(186): Opened tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:19,570 INFO [PostOpenDeployTasks:e16cb91aec0ea3dd068fbaf236ee81fa] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:15:19,571 DEBUG [AM.ZK.Worker-pool2-t9] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=850bc9f74b9620f114115790531a78ae, current state from region state map ={850bc9f74b9620f114115790531a78ae state=OPENING, ts=1377814517739, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:19,571 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates(263): Transitioned from {850bc9f74b9620f114115790531a78ae state=OPENING, ts=1377814517739, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {850bc9f74b9620f114115790531a78ae state=OPEN, ts=1377814519571, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:19,571 DEBUG [AM.ZK.Worker-pool2-t9] handler.OpenedRegionHandler(150): Handling OPENED event for 850bc9f74b9620f114115790531a78ae from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:19,572 DEBUG [AM.ZK.Worker-pool2-t9] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 850bc9f74b9620f114115790531a78ae in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:19,715 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:19,719 INFO [RpcServer.handler=0,port=44745] master.AssignmentManager(1917): Assigning tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:19,719 INFO [RpcServer.handler=0,port=44745] master.RegionStates(263): Transitioned from {632b714a3ec4d729e14be6daae99619a state=OFFLINE, ts=1377814519291, server=null} to {632b714a3ec4d729e14be6daae99619a state=PENDING_OPEN, ts=1377814519719, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:19,720 INFO [RpcServer.handler=1,port=51291] regionserver.HRegionServer(3521): Open tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:19,722 INFO [PostOpenDeployTasks:e16cb91aec0ea3dd068fbaf236ee81fa] catalog.MetaEditor(462): Updated row tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:19,722 INFO [PostOpenDeployTasks:e16cb91aec0ea3dd068fbaf236ee81fa] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:15:19,722 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning e16cb91aec0ea3dd068fbaf236ee81fa from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:19,725 INFO [IPC Server handler 6 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:19,725 INFO [IPC Server handler 1 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:19,860 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/850bc9f74b9620f114115790531a78ae 2013-08-29 22:15:19,861 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 632b714a3ec4d729e14be6daae99619a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:19,861 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:19,864 DEBUG [AM.ZK.Worker-pool2-t9] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 850bc9f74b9620f114115790531a78ae in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:19,864 DEBUG [AM.ZK.Worker-pool2-t9] master.AssignmentManager$4(1276): Znode tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. deleted, state: {850bc9f74b9620f114115790531a78ae state=OPEN, ts=1377814519571, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:19,864 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates(299): Onlined 850bc9f74b9620f114115790531a78ae on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,004 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e16cb91aec0ea3dd068fbaf236ee81fa 2013-08-29 22:15:20,005 INFO [StoreOpener-013bc94b13efec611d74c9d002c0f201-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:20,005 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node e16cb91aec0ea3dd068fbaf236ee81fa from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:20,007 DEBUG [RS_OPEN_REGION-kiyo:57016-1] handler.OpenRegionHandler(376): Transitioned e16cb91aec0ea3dd068fbaf236ee81fa to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:20,007 DEBUG [AM.ZK.Worker-pool2-t13] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=e16cb91aec0ea3dd068fbaf236ee81fa, current state from region state map ={e16cb91aec0ea3dd068fbaf236ee81fa state=OPENING, ts=1377814517691, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:20,007 DEBUG [RS_OPEN_REGION-kiyo:57016-1] handler.OpenRegionHandler(186): Opened tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:20,007 INFO [AM.ZK.Worker-pool2-t13] master.RegionStates(263): Transitioned from {e16cb91aec0ea3dd068fbaf236ee81fa state=OPENING, ts=1377814517691, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {e16cb91aec0ea3dd068fbaf236ee81fa state=OPEN, ts=1377814520007, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:20,008 DEBUG [AM.ZK.Worker-pool2-t13] handler.OpenedRegionHandler(150): Handling OPENED event for e16cb91aec0ea3dd068fbaf236ee81fa from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:20,008 DEBUG [AM.ZK.Worker-pool2-t13] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node e16cb91aec0ea3dd068fbaf236ee81fa in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:20,011 INFO [RpcServer.handler=1,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:20,011 DEBUG [RpcServer.handler=1,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. so generated a random one; hri=tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:20,011 DEBUG [RpcServer.handler=1,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 8312930da68dfb12296f5cbb3a37f843 with OFFLINE state 2013-08-29 22:15:20,051 INFO [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(630): Onlined 013bc94b13efec611d74c9d002c0f201; next sequenceid=1 2013-08-29 22:15:20,052 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 013bc94b13efec611d74c9d002c0f201 2013-08-29 22:15:20,143 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/632b714a3ec4d729e14be6daae99619a 2013-08-29 22:15:20,143 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 632b714a3ec4d729e14be6daae99619a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:20,144 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(4085): Opening region: {ENCODED => 632b714a3ec4d729e14be6daae99619a, NAME => 'tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2013-08-29 22:15:20,145 INFO [PostOpenDeployTasks:013bc94b13efec611d74c9d002c0f201] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:20,145 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 632b714a3ec4d729e14be6daae99619a 2013-08-29 22:15:20,145 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(535): Instantiated tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:20,147 DEBUG [AM.ZK.Worker-pool2-t14] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=632b714a3ec4d729e14be6daae99619a, current state from region state map ={632b714a3ec4d729e14be6daae99619a state=PENDING_OPEN, ts=1377814519719, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,147 INFO [AM.ZK.Worker-pool2-t14] master.RegionStates(263): Transitioned from {632b714a3ec4d729e14be6daae99619a state=PENDING_OPEN, ts=1377814519719, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {632b714a3ec4d729e14be6daae99619a state=OPENING, ts=1377814520147, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,148 WARN [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 632b714a3ec4d729e14be6daae99619a 2013-08-29 22:15:20,170 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/e16cb91aec0ea3dd068fbaf236ee81fa 2013-08-29 22:15:20,171 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:20,172 DEBUG [AM.ZK.Worker-pool2-t13] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node e16cb91aec0ea3dd068fbaf236ee81fa in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:20,172 DEBUG [AM.ZK.Worker-pool2-t13] master.AssignmentManager$4(1276): Znode tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. deleted, state: {e16cb91aec0ea3dd068fbaf236ee81fa state=OPEN, ts=1377814520007, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:20,172 INFO [AM.ZK.Worker-pool2-t13] master.RegionStates(299): Onlined e16cb91aec0ea3dd068fbaf236ee81fa on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:20,207 INFO [StoreOpener-411506c2261eadd186d247f40f8b53d0-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:20,208 INFO [RpcServer.handler=1,port=44745] master.AssignmentManager(1917): Assigning tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,208 INFO [RpcServer.handler=1,port=44745] master.RegionStates(263): Transitioned from {8312930da68dfb12296f5cbb3a37f843 state=OFFLINE, ts=1377814520011, server=null} to {8312930da68dfb12296f5cbb3a37f843 state=PENDING_OPEN, ts=1377814520208, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,209 INFO [RpcServer.handler=2,port=51291] regionserver.HRegionServer(3521): Open tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:20,210 INFO [PostOpenDeployTasks:013bc94b13efec611d74c9d002c0f201] catalog.MetaEditor(462): Updated row tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,210 INFO [PostOpenDeployTasks:013bc94b13efec611d74c9d002c0f201] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:20,211 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 013bc94b13efec611d74c9d002c0f201 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:20,216 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:20,217 INFO [IPC Server handler 6 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:20,219 INFO [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(630): Onlined 411506c2261eadd186d247f40f8b53d0; next sequenceid=1 2013-08-29 22:15:20,219 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 411506c2261eadd186d247f40f8b53d0 2013-08-29 22:15:20,307 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 013bc94b13efec611d74c9d002c0f201 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:20,307 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/013bc94b13efec611d74c9d002c0f201 2013-08-29 22:15:20,307 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(376): Transitioned 013bc94b13efec611d74c9d002c0f201 to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,307 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(186): Opened tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,308 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 8312930da68dfb12296f5cbb3a37f843 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:20,311 DEBUG [AM.ZK.Worker-pool2-t17] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=013bc94b13efec611d74c9d002c0f201, current state from region state map ={013bc94b13efec611d74c9d002c0f201 state=OPENING, ts=1377814517805, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,311 INFO [AM.ZK.Worker-pool2-t17] master.RegionStates(263): Transitioned from {013bc94b13efec611d74c9d002c0f201 state=OPENING, ts=1377814517805, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {013bc94b13efec611d74c9d002c0f201 state=OPEN, ts=1377814520311, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,311 DEBUG [AM.ZK.Worker-pool2-t17] handler.OpenedRegionHandler(150): Handling OPENED event for 013bc94b13efec611d74c9d002c0f201 from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:20,311 INFO [PostOpenDeployTasks:411506c2261eadd186d247f40f8b53d0] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:20,311 DEBUG [AM.ZK.Worker-pool2-t17] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 013bc94b13efec611d74c9d002c0f201 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:20,314 INFO [RpcServer.handler=4,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:20,314 DEBUG [RpcServer.handler=4,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. so generated a random one; hri=tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:20,317 DEBUG [RpcServer.handler=4,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 768e8db1c5d6cfe64da81f9daecf0999 with OFFLINE state 2013-08-29 22:15:20,337 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/8312930da68dfb12296f5cbb3a37f843 2013-08-29 22:15:20,337 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 8312930da68dfb12296f5cbb3a37f843 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:20,337 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(4085): Opening region: {ENCODED => 8312930da68dfb12296f5cbb3a37f843, NAME => 'tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2013-08-29 22:15:20,338 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 8312930da68dfb12296f5cbb3a37f843 2013-08-29 22:15:20,338 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(535): Instantiated tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:20,340 WARN [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 8312930da68dfb12296f5cbb3a37f843 2013-08-29 22:15:20,370 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/013bc94b13efec611d74c9d002c0f201 2013-08-29 22:15:20,370 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:20,371 DEBUG [AM.ZK.Worker-pool2-t17] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 013bc94b13efec611d74c9d002c0f201 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:20,371 DEBUG [AM.ZK.Worker-pool2-t17] master.AssignmentManager$4(1276): Znode tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. deleted, state: {013bc94b13efec611d74c9d002c0f201 state=OPEN, ts=1377814520311, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,371 INFO [AM.ZK.Worker-pool2-t17] master.RegionStates(299): Onlined 013bc94b13efec611d74c9d002c0f201 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,372 DEBUG [AM.ZK.Worker-pool2-t18] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=8312930da68dfb12296f5cbb3a37f843, current state from region state map ={8312930da68dfb12296f5cbb3a37f843 state=PENDING_OPEN, ts=1377814520208, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,373 INFO [AM.ZK.Worker-pool2-t18] master.RegionStates(263): Transitioned from {8312930da68dfb12296f5cbb3a37f843 state=PENDING_OPEN, ts=1377814520208, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {8312930da68dfb12296f5cbb3a37f843 state=OPENING, ts=1377814520373, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,375 INFO [PostOpenDeployTasks:411506c2261eadd186d247f40f8b53d0] catalog.MetaEditor(462): Updated row tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,375 INFO [PostOpenDeployTasks:411506c2261eadd186d247f40f8b53d0] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:20,375 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 411506c2261eadd186d247f40f8b53d0 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:20,476 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:20,478 INFO [RpcServer.handler=4,port=44745] master.AssignmentManager(1917): Assigning tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,478 INFO [RpcServer.handler=4,port=44745] master.RegionStates(263): Transitioned from {768e8db1c5d6cfe64da81f9daecf0999 state=OFFLINE, ts=1377814520317, server=null} to {768e8db1c5d6cfe64da81f9daecf0999 state=PENDING_OPEN, ts=1377814520478, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,479 INFO [RpcServer.handler=3,port=51291] regionserver.HRegionServer(3521): Open tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:20,533 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:20,534 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741844_1020 size 48 2013-08-29 22:15:20,542 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/411506c2261eadd186d247f40f8b53d0 2013-08-29 22:15:20,542 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 411506c2261eadd186d247f40f8b53d0 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:20,542 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(376): Transitioned 411506c2261eadd186d247f40f8b53d0 to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,542 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(186): Opened tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,543 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 768e8db1c5d6cfe64da81f9daecf0999 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:20,544 DEBUG [AM.ZK.Worker-pool2-t3] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=411506c2261eadd186d247f40f8b53d0, current state from region state map ={411506c2261eadd186d247f40f8b53d0 state=OPENING, ts=1377814517884, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,544 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates(263): Transitioned from {411506c2261eadd186d247f40f8b53d0 state=OPENING, ts=1377814517884, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {411506c2261eadd186d247f40f8b53d0 state=OPEN, ts=1377814520544, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,544 DEBUG [AM.ZK.Worker-pool2-t3] handler.OpenedRegionHandler(150): Handling OPENED event for 411506c2261eadd186d247f40f8b53d0 from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:20,544 DEBUG [AM.ZK.Worker-pool2-t3] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 411506c2261eadd186d247f40f8b53d0 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:20,750 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/768e8db1c5d6cfe64da81f9daecf0999 2013-08-29 22:15:20,750 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 768e8db1c5d6cfe64da81f9daecf0999 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:20,750 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(4085): Opening region: {ENCODED => 768e8db1c5d6cfe64da81f9daecf0999, NAME => 'tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2013-08-29 22:15:20,751 INFO [StoreOpener-9726b1bb649d384a3531183536e758f2-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:20,752 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 768e8db1c5d6cfe64da81f9daecf0999 2013-08-29 22:15:20,752 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(535): Instantiated tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:20,753 WARN [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 768e8db1c5d6cfe64da81f9daecf0999 2013-08-29 22:15:20,758 INFO [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(630): Onlined 9726b1bb649d384a3531183536e758f2; next sequenceid=1 2013-08-29 22:15:20,758 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 9726b1bb649d384a3531183536e758f2 2013-08-29 22:15:20,850 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/411506c2261eadd186d247f40f8b53d0 2013-08-29 22:15:20,851 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:20,852 INFO [PostOpenDeployTasks:9726b1bb649d384a3531183536e758f2] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:15:20,852 DEBUG [AM.ZK.Worker-pool2-t3] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 411506c2261eadd186d247f40f8b53d0 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:20,853 DEBUG [AM.ZK.Worker-pool2-t3] master.AssignmentManager$4(1276): Znode tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. deleted, state: {411506c2261eadd186d247f40f8b53d0 state=OPEN, ts=1377814520544, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,853 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates(299): Onlined 411506c2261eadd186d247f40f8b53d0 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,853 INFO [RpcServer.handler=2,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:20,854 DEBUG [AM.ZK.Worker-pool2-t5] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=768e8db1c5d6cfe64da81f9daecf0999, current state from region state map ={768e8db1c5d6cfe64da81f9daecf0999 state=PENDING_OPEN, ts=1377814520478, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,854 DEBUG [RpcServer.handler=2,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. so generated a random one; hri=tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:20,854 INFO [AM.ZK.Worker-pool2-t5] master.RegionStates(263): Transitioned from {768e8db1c5d6cfe64da81f9daecf0999 state=PENDING_OPEN, ts=1377814520478, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {768e8db1c5d6cfe64da81f9daecf0999 state=OPENING, ts=1377814520854, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,855 DEBUG [RpcServer.handler=2,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node e27461887c1893e0726079fcddd51b6a with OFFLINE state 2013-08-29 22:15:20,861 INFO [PostOpenDeployTasks:9726b1bb649d384a3531183536e758f2] catalog.MetaEditor(462): Updated row tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:20,861 INFO [PostOpenDeployTasks:9726b1bb649d384a3531183536e758f2] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:15:20,861 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 9726b1bb649d384a3531183536e758f2 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:20,992 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:20,993 INFO [StoreOpener-11a9c621d13d5b11ed27a0104fdd0798-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:20,995 INFO [RpcServer.handler=2,port=44745] master.AssignmentManager(1917): Assigning tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:20,995 INFO [RpcServer.handler=2,port=44745] master.RegionStates(263): Transitioned from {e27461887c1893e0726079fcddd51b6a state=OFFLINE, ts=1377814520855, server=null} to {e27461887c1893e0726079fcddd51b6a state=PENDING_OPEN, ts=1377814520995, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:20,996 INFO [RpcServer.handler=4,port=51291] regionserver.HRegionServer(3521): Open tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:21,000 INFO [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(630): Onlined 11a9c621d13d5b11ed27a0104fdd0798; next sequenceid=1 2013-08-29 22:15:21,001 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 11a9c621d13d5b11ed27a0104fdd0798 2013-08-29 22:15:21,015 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/9726b1bb649d384a3531183536e758f2 2013-08-29 22:15:21,015 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 9726b1bb649d384a3531183536e758f2 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:21,015 DEBUG [RS_OPEN_REGION-kiyo:57016-2] handler.OpenRegionHandler(376): Transitioned 9726b1bb649d384a3531183536e758f2 to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:21,015 DEBUG [RS_OPEN_REGION-kiyo:57016-2] handler.OpenRegionHandler(186): Opened tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:21,017 DEBUG [AM.ZK.Worker-pool2-t7] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=9726b1bb649d384a3531183536e758f2, current state from region state map ={9726b1bb649d384a3531183536e758f2 state=OPENING, ts=1377814517984, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:21,017 INFO [AM.ZK.Worker-pool2-t7] master.RegionStates(263): Transitioned from {9726b1bb649d384a3531183536e758f2 state=OPENING, ts=1377814517984, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {9726b1bb649d384a3531183536e758f2 state=OPEN, ts=1377814521017, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:21,017 DEBUG [AM.ZK.Worker-pool2-t7] handler.OpenedRegionHandler(150): Handling OPENED event for 9726b1bb649d384a3531183536e758f2 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:21,017 DEBUG [AM.ZK.Worker-pool2-t7] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 9726b1bb649d384a3531183536e758f2 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:21,017 INFO [PostOpenDeployTasks:11a9c621d13d5b11ed27a0104fdd0798] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:15:21,025 INFO [PostOpenDeployTasks:11a9c621d13d5b11ed27a0104fdd0798] catalog.MetaEditor(462): Updated row tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:21,025 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:21,025 INFO [PostOpenDeployTasks:11a9c621d13d5b11ed27a0104fdd0798] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:15:21,026 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 11a9c621d13d5b11ed27a0104fdd0798 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:21,027 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741845_1021 size 48 2013-08-29 22:15:21,300 INFO [StoreOpener-632b714a3ec4d729e14be6daae99619a-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:21,309 INFO [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(630): Onlined 632b714a3ec4d729e14be6daae99619a; next sequenceid=1 2013-08-29 22:15:21,309 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 632b714a3ec4d729e14be6daae99619a 2013-08-29 22:15:21,744 INFO [StoreOpener-8312930da68dfb12296f5cbb3a37f843-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:21,752 INFO [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(630): Onlined 8312930da68dfb12296f5cbb3a37f843; next sequenceid=1 2013-08-29 22:15:21,752 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 8312930da68dfb12296f5cbb3a37f843 2013-08-29 22:15:21,935 INFO [StoreOpener-768e8db1c5d6cfe64da81f9daecf0999-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:21,944 INFO [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(630): Onlined 768e8db1c5d6cfe64da81f9daecf0999; next sequenceid=1 2013-08-29 22:15:21,944 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 768e8db1c5d6cfe64da81f9daecf0999 2013-08-29 22:15:22,182 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/9726b1bb649d384a3531183536e758f2 2013-08-29 22:15:22,182 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:22,185 DEBUG [AM.ZK.Worker-pool2-t7] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 9726b1bb649d384a3531183536e758f2 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,185 DEBUG [AM.ZK.Worker-pool2-t7] master.AssignmentManager$4(1276): Znode tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. deleted, state: {9726b1bb649d384a3531183536e758f2 state=OPEN, ts=1377814521017, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:22,185 INFO [AM.ZK.Worker-pool2-t7] master.RegionStates(299): Onlined 9726b1bb649d384a3531183536e758f2 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:22,186 INFO [PostOpenDeployTasks:632b714a3ec4d729e14be6daae99619a] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:22,187 INFO [RpcServer.handler=3,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:22,187 DEBUG [RpcServer.handler=3,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. so generated a random one; hri=tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:22,187 DEBUG [RpcServer.handler=3,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 5083515e811013bc2a8be90523d4a81a with OFFLINE state 2013-08-29 22:15:22,188 INFO [PostOpenDeployTasks:8312930da68dfb12296f5cbb3a37f843] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:22,193 INFO [PostOpenDeployTasks:768e8db1c5d6cfe64da81f9daecf0999] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:22,243 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/11a9c621d13d5b11ed27a0104fdd0798 2013-08-29 22:15:22,244 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 11a9c621d13d5b11ed27a0104fdd0798 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:22,244 DEBUG [RS_OPEN_REGION-kiyo:57016-0] handler.OpenRegionHandler(376): Transitioned 11a9c621d13d5b11ed27a0104fdd0798 to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:22,244 DEBUG [RS_OPEN_REGION-kiyo:57016-0] handler.OpenRegionHandler(186): Opened tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:22,247 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=11a9c621d13d5b11ed27a0104fdd0798, current state from region state map ={11a9c621d13d5b11ed27a0104fdd0798 state=OPENING, ts=1377814519287, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:22,247 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates(263): Transitioned from {11a9c621d13d5b11ed27a0104fdd0798 state=OPENING, ts=1377814519287, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {11a9c621d13d5b11ed27a0104fdd0798 state=OPEN, ts=1377814522247, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:22,247 DEBUG [AM.ZK.Worker-pool2-t12] handler.OpenedRegionHandler(150): Handling OPENED event for 11a9c621d13d5b11ed27a0104fdd0798 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:22,247 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 11a9c621d13d5b11ed27a0104fdd0798 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,250 INFO [PostOpenDeployTasks:632b714a3ec4d729e14be6daae99619a] catalog.MetaEditor(462): Updated row tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,250 INFO [PostOpenDeployTasks:632b714a3ec4d729e14be6daae99619a] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:22,251 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 632b714a3ec4d729e14be6daae99619a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:22,275 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:22,280 INFO [PostOpenDeployTasks:8312930da68dfb12296f5cbb3a37f843] catalog.MetaEditor(462): Updated row tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,280 INFO [PostOpenDeployTasks:8312930da68dfb12296f5cbb3a37f843] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:22,282 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 8312930da68dfb12296f5cbb3a37f843 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:22,320 INFO [PostOpenDeployTasks:768e8db1c5d6cfe64da81f9daecf0999] catalog.MetaEditor(462): Updated row tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,320 INFO [PostOpenDeployTasks:768e8db1c5d6cfe64da81f9daecf0999] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:22,320 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 768e8db1c5d6cfe64da81f9daecf0999 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:22,326 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/632b714a3ec4d729e14be6daae99619a 2013-08-29 22:15:22,327 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 632b714a3ec4d729e14be6daae99619a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:22,327 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(376): Transitioned 632b714a3ec4d729e14be6daae99619a to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,327 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(186): Opened tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,328 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning e27461887c1893e0726079fcddd51b6a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:22,332 INFO [RpcServer.handler=3,port=44745] master.AssignmentManager(1917): Assigning tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,332 INFO [RpcServer.handler=3,port=44745] master.RegionStates(263): Transitioned from {5083515e811013bc2a8be90523d4a81a state=OFFLINE, ts=1377814522187, server=null} to {5083515e811013bc2a8be90523d4a81a state=PENDING_OPEN, ts=1377814522332, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,333 INFO [RpcServer.handler=0,port=51291] regionserver.HRegionServer(3521): Open tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:22,407 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/11a9c621d13d5b11ed27a0104fdd0798 2013-08-29 22:15:22,408 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:22,409 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 11a9c621d13d5b11ed27a0104fdd0798 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,410 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager$4(1276): Znode tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. deleted, state: {11a9c621d13d5b11ed27a0104fdd0798 state=OPEN, ts=1377814522247, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:22,410 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates(299): Onlined 11a9c621d13d5b11ed27a0104fdd0798 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:22,411 DEBUG [AM.ZK.Worker-pool2-t10] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=632b714a3ec4d729e14be6daae99619a, current state from region state map ={632b714a3ec4d729e14be6daae99619a state=OPENING, ts=1377814520147, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,411 INFO [AM.ZK.Worker-pool2-t10] master.RegionStates(263): Transitioned from {632b714a3ec4d729e14be6daae99619a state=OPENING, ts=1377814520147, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {632b714a3ec4d729e14be6daae99619a state=OPEN, ts=1377814522411, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,412 DEBUG [AM.ZK.Worker-pool2-t10] handler.OpenedRegionHandler(150): Handling OPENED event for 632b714a3ec4d729e14be6daae99619a from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:22,412 DEBUG [AM.ZK.Worker-pool2-t10] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 632b714a3ec4d729e14be6daae99619a in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,423 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/8312930da68dfb12296f5cbb3a37f843 2013-08-29 22:15:22,424 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 8312930da68dfb12296f5cbb3a37f843 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:22,424 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(376): Transitioned 8312930da68dfb12296f5cbb3a37f843 to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,424 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(186): Opened tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,425 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 5083515e811013bc2a8be90523d4a81a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:22,440 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/768e8db1c5d6cfe64da81f9daecf0999 2013-08-29 22:15:22,441 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 768e8db1c5d6cfe64da81f9daecf0999 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:22,441 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(376): Transitioned 768e8db1c5d6cfe64da81f9daecf0999 to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,441 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(186): Opened tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,442 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node e27461887c1893e0726079fcddd51b6a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:22,442 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(4085): Opening region: {ENCODED => e27461887c1893e0726079fcddd51b6a, NAME => 'tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2013-08-29 22:15:22,443 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest e27461887c1893e0726079fcddd51b6a 2013-08-29 22:15:22,444 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e27461887c1893e0726079fcddd51b6a 2013-08-29 22:15:22,444 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(535): Instantiated tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:22,445 DEBUG [AM.ZK.Worker-pool2-t13] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=8312930da68dfb12296f5cbb3a37f843, current state from region state map ={8312930da68dfb12296f5cbb3a37f843 state=OPENING, ts=1377814520373, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,445 INFO [RpcServer.handler=1,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:22,445 INFO [AM.ZK.Worker-pool2-t13] master.RegionStates(263): Transitioned from {8312930da68dfb12296f5cbb3a37f843 state=OPENING, ts=1377814520373, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {8312930da68dfb12296f5cbb3a37f843 state=OPEN, ts=1377814522445, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,446 DEBUG [AM.ZK.Worker-pool2-t13] handler.OpenedRegionHandler(150): Handling OPENED event for 8312930da68dfb12296f5cbb3a37f843 from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:22,446 WARN [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: e27461887c1893e0726079fcddd51b6a 2013-08-29 22:15:22,447 DEBUG [AM.ZK.Worker-pool2-t15] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=768e8db1c5d6cfe64da81f9daecf0999, current state from region state map ={768e8db1c5d6cfe64da81f9daecf0999 state=OPENING, ts=1377814520854, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,447 DEBUG [AM.ZK.Worker-pool2-t13] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 8312930da68dfb12296f5cbb3a37f843 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,446 DEBUG [RpcServer.handler=1,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. so generated a random one; hri=tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:22,447 INFO [AM.ZK.Worker-pool2-t15] master.RegionStates(263): Transitioned from {768e8db1c5d6cfe64da81f9daecf0999 state=OPENING, ts=1377814520854, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {768e8db1c5d6cfe64da81f9daecf0999 state=OPEN, ts=1377814522447, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,447 DEBUG [RpcServer.handler=1,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 725a1977cc9ede4514e8029d5522b6ee with OFFLINE state 2013-08-29 22:15:22,447 DEBUG [AM.ZK.Worker-pool2-t15] handler.OpenedRegionHandler(150): Handling OPENED event for 768e8db1c5d6cfe64da81f9daecf0999 from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:22,448 DEBUG [AM.ZK.Worker-pool2-t15] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 768e8db1c5d6cfe64da81f9daecf0999 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,465 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/632b714a3ec4d729e14be6daae99619a 2013-08-29 22:15:22,465 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:22,466 DEBUG [AM.ZK.Worker-pool2-t10] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 632b714a3ec4d729e14be6daae99619a in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,466 DEBUG [AM.ZK.Worker-pool2-t10] master.AssignmentManager$4(1276): Znode tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. deleted, state: {632b714a3ec4d729e14be6daae99619a state=OPEN, ts=1377814522411, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,466 INFO [AM.ZK.Worker-pool2-t10] master.RegionStates(299): Onlined 632b714a3ec4d729e14be6daae99619a on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,537 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 5083515e811013bc2a8be90523d4a81a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:22,539 DEBUG [AM.ZK.Worker-pool2-t20] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=e27461887c1893e0726079fcddd51b6a, current state from region state map ={e27461887c1893e0726079fcddd51b6a state=PENDING_OPEN, ts=1377814520995, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,539 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(4085): Opening region: {ENCODED => 5083515e811013bc2a8be90523d4a81a, NAME => 'tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2013-08-29 22:15:22,539 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5083515e811013bc2a8be90523d4a81a 2013-08-29 22:15:22,539 INFO [AM.ZK.Worker-pool2-t20] master.RegionStates(263): Transitioned from {e27461887c1893e0726079fcddd51b6a state=PENDING_OPEN, ts=1377814520995, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {e27461887c1893e0726079fcddd51b6a state=OPENING, ts=1377814522539, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,540 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 5083515e811013bc2a8be90523d4a81a 2013-08-29 22:15:22,541 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(535): Instantiated tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:22,544 WARN [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 5083515e811013bc2a8be90523d4a81a 2013-08-29 22:15:22,550 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:22,551 INFO [IPC Server handler 6 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:22,677 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/8312930da68dfb12296f5cbb3a37f843 2013-08-29 22:15:22,677 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:22,678 DEBUG [AM.ZK.Worker-pool2-t13] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 8312930da68dfb12296f5cbb3a37f843 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,678 DEBUG [AM.ZK.Worker-pool2-t13] master.AssignmentManager$4(1276): Znode tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. deleted, state: {8312930da68dfb12296f5cbb3a37f843 state=OPEN, ts=1377814522445, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,678 INFO [AM.ZK.Worker-pool2-t13] master.RegionStates(299): Onlined 8312930da68dfb12296f5cbb3a37f843 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,679 DEBUG [AM.ZK.Worker-pool2-t20] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=5083515e811013bc2a8be90523d4a81a, current state from region state map ={5083515e811013bc2a8be90523d4a81a state=PENDING_OPEN, ts=1377814522332, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,679 INFO [AM.ZK.Worker-pool2-t20] master.RegionStates(263): Transitioned from {5083515e811013bc2a8be90523d4a81a state=PENDING_OPEN, ts=1377814522332, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {5083515e811013bc2a8be90523d4a81a state=OPENING, ts=1377814522679, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,729 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:22,730 INFO [IPC Server handler 1 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:22,768 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/768e8db1c5d6cfe64da81f9daecf0999 2013-08-29 22:15:22,768 DEBUG [AM.ZK.Worker-pool2-t15] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 768e8db1c5d6cfe64da81f9daecf0999 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:22,768 DEBUG [AM.ZK.Worker-pool2-t15] master.AssignmentManager$4(1276): Znode tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. deleted, state: {768e8db1c5d6cfe64da81f9daecf0999 state=OPEN, ts=1377814522447, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,769 INFO [AM.ZK.Worker-pool2-t15] master.RegionStates(299): Onlined 768e8db1c5d6cfe64da81f9daecf0999 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,770 INFO [RpcServer.handler=1,port=44745] master.AssignmentManager(1917): Assigning tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:22,770 INFO [RpcServer.handler=1,port=44745] master.RegionStates(263): Transitioned from {725a1977cc9ede4514e8029d5522b6ee state=OFFLINE, ts=1377814522447, server=null} to {725a1977cc9ede4514e8029d5522b6ee state=PENDING_OPEN, ts=1377814522770, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,771 INFO [RpcServer.handler=1,port=51291] regionserver.HRegionServer(3521): Open tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:22,774 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 725a1977cc9ede4514e8029d5522b6ee from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:22,815 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/725a1977cc9ede4514e8029d5522b6ee 2013-08-29 22:15:22,815 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 725a1977cc9ede4514e8029d5522b6ee from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:22,815 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(4085): Opening region: {ENCODED => 725a1977cc9ede4514e8029d5522b6ee, NAME => 'tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2013-08-29 22:15:22,816 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 725a1977cc9ede4514e8029d5522b6ee 2013-08-29 22:15:22,816 DEBUG [AM.ZK.Worker-pool2-t5] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=725a1977cc9ede4514e8029d5522b6ee, current state from region state map ={725a1977cc9ede4514e8029d5522b6ee state=PENDING_OPEN, ts=1377814522770, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,817 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(535): Instantiated tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:22,817 INFO [AM.ZK.Worker-pool2-t5] master.RegionStates(263): Transitioned from {725a1977cc9ede4514e8029d5522b6ee state=PENDING_OPEN, ts=1377814522770, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {725a1977cc9ede4514e8029d5522b6ee state=OPENING, ts=1377814522817, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:22,820 INFO [RpcServer.handler=0,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:15:22,820 DEBUG [RpcServer.handler=0,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. so generated a random one; hri=tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:22,820 DEBUG [RpcServer.handler=0,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 60dd6b689221b85fed89c65d2cfd13b2 with OFFLINE state 2013-08-29 22:15:22,835 WARN [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 725a1977cc9ede4514e8029d5522b6ee 2013-08-29 22:15:22,856 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:22,858 INFO [RpcServer.handler=0,port=44745] master.AssignmentManager(1917): Assigning tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:22,859 INFO [RpcServer.handler=0,port=44745] master.RegionStates(263): Transitioned from {60dd6b689221b85fed89c65d2cfd13b2 state=OFFLINE, ts=1377814522820, server=null} to {60dd6b689221b85fed89c65d2cfd13b2 state=PENDING_OPEN, ts=1377814522859, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:22,860 INFO [RpcServer.handler=4,port=57016] regionserver.HRegionServer(3521): Open tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:15:22,863 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 60dd6b689221b85fed89c65d2cfd13b2 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:22,906 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/60dd6b689221b85fed89c65d2cfd13b2 2013-08-29 22:15:22,907 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 60dd6b689221b85fed89c65d2cfd13b2 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:22,907 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(4085): Opening region: {ENCODED => 60dd6b689221b85fed89c65d2cfd13b2, NAME => 'tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2013-08-29 22:15:22,908 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 60dd6b689221b85fed89c65d2cfd13b2 2013-08-29 22:15:22,908 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(535): Instantiated tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:15:22,909 DEBUG [AM.ZK.Worker-pool2-t6] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=60dd6b689221b85fed89c65d2cfd13b2, current state from region state map ={60dd6b689221b85fed89c65d2cfd13b2 state=PENDING_OPEN, ts=1377814522859, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:22,910 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates(263): Transitioned from {60dd6b689221b85fed89c65d2cfd13b2 state=PENDING_OPEN, ts=1377814522859, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {60dd6b689221b85fed89c65d2cfd13b2 state=OPENING, ts=1377814522910, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:22,910 WARN [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 60dd6b689221b85fed89c65d2cfd13b2 2013-08-29 22:15:22,912 INFO [RpcServer.handler=4,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:15:22,913 DEBUG [RpcServer.handler=4,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. so generated a random one; hri=tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:22,913 DEBUG [RpcServer.handler=4,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 16d9fd46b6932e1be21e5e7f4dd79ac4 with OFFLINE state 2013-08-29 22:15:22,966 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:22,969 INFO [RpcServer.handler=4,port=44745] master.AssignmentManager(1917): Assigning tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:22,969 INFO [RpcServer.handler=4,port=44745] master.RegionStates(263): Transitioned from {16d9fd46b6932e1be21e5e7f4dd79ac4 state=OFFLINE, ts=1377814522913, server=null} to {16d9fd46b6932e1be21e5e7f4dd79ac4 state=PENDING_OPEN, ts=1377814522969, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:22,970 INFO [RpcServer.handler=0,port=57016] regionserver.HRegionServer(3521): Open tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:15:22,973 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 16d9fd46b6932e1be21e5e7f4dd79ac4 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,001 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:23,003 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741848_1024 size 48 2013-08-29 22:15:23,006 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/16d9fd46b6932e1be21e5e7f4dd79ac4 2013-08-29 22:15:23,007 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 16d9fd46b6932e1be21e5e7f4dd79ac4 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,007 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(4085): Opening region: {ENCODED => 16d9fd46b6932e1be21e5e7f4dd79ac4, NAME => 'tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2013-08-29 22:15:23,008 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 16d9fd46b6932e1be21e5e7f4dd79ac4 2013-08-29 22:15:23,009 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(535): Instantiated tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:15:23,009 DEBUG [AM.ZK.Worker-pool2-t7] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=16d9fd46b6932e1be21e5e7f4dd79ac4, current state from region state map ={16d9fd46b6932e1be21e5e7f4dd79ac4 state=PENDING_OPEN, ts=1377814522969, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,009 INFO [AM.ZK.Worker-pool2-t7] master.RegionStates(263): Transitioned from {16d9fd46b6932e1be21e5e7f4dd79ac4 state=PENDING_OPEN, ts=1377814522969, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {16d9fd46b6932e1be21e5e7f4dd79ac4 state=OPENING, ts=1377814523009, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,011 INFO [RpcServer.handler=2,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:15:23,011 DEBUG [RpcServer.handler=2,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. so generated a random one; hri=tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:23,011 DEBUG [RpcServer.handler=2,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node e0f77722c886c7dbde9efcde4f60c2c6 with OFFLINE state 2013-08-29 22:15:23,011 WARN [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 16d9fd46b6932e1be21e5e7f4dd79ac4 2013-08-29 22:15:23,034 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:23,036 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741849_1025 size 48 2013-08-29 22:15:23,076 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,077 INFO [RpcServer.handler=2,port=44745] master.AssignmentManager(1917): Assigning tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,077 INFO [RpcServer.handler=2,port=44745] master.RegionStates(263): Transitioned from {e0f77722c886c7dbde9efcde4f60c2c6 state=OFFLINE, ts=1377814523011, server=null} to {e0f77722c886c7dbde9efcde4f60c2c6 state=PENDING_OPEN, ts=1377814523077, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,078 INFO [RpcServer.handler=1,port=57016] regionserver.HRegionServer(3521): Open tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:15:23,082 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning e0f77722c886c7dbde9efcde4f60c2c6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,085 INFO [StoreOpener-e27461887c1893e0726079fcddd51b6a-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:23,092 INFO [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(630): Onlined e27461887c1893e0726079fcddd51b6a; next sequenceid=1 2013-08-29 22:15:23,092 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node e27461887c1893e0726079fcddd51b6a 2013-08-29 22:15:23,109 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e0f77722c886c7dbde9efcde4f60c2c6 2013-08-29 22:15:23,109 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node e0f77722c886c7dbde9efcde4f60c2c6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,110 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(4085): Opening region: {ENCODED => e0f77722c886c7dbde9efcde4f60c2c6, NAME => 'tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2013-08-29 22:15:23,110 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest e0f77722c886c7dbde9efcde4f60c2c6 2013-08-29 22:15:23,111 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(535): Instantiated tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:15:23,112 DEBUG [AM.ZK.Worker-pool2-t9] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=e0f77722c886c7dbde9efcde4f60c2c6, current state from region state map ={e0f77722c886c7dbde9efcde4f60c2c6 state=PENDING_OPEN, ts=1377814523077, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,112 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates(263): Transitioned from {e0f77722c886c7dbde9efcde4f60c2c6 state=PENDING_OPEN, ts=1377814523077, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {e0f77722c886c7dbde9efcde4f60c2c6 state=OPENING, ts=1377814523112, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,113 INFO [PostOpenDeployTasks:e27461887c1893e0726079fcddd51b6a] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:23,114 INFO [RpcServer.handler=3,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:15:23,114 DEBUG [RpcServer.handler=3,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. so generated a random one; hri=tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:23,114 DEBUG [RpcServer.handler=3,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 63449e4bed174f301e94011ae27a579b with OFFLINE state 2013-08-29 22:15:23,115 WARN [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: e0f77722c886c7dbde9efcde4f60c2c6 2013-08-29 22:15:23,121 INFO [PostOpenDeployTasks:e27461887c1893e0726079fcddd51b6a] catalog.MetaEditor(462): Updated row tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,121 INFO [PostOpenDeployTasks:e27461887c1893e0726079fcddd51b6a] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:23,121 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning e27461887c1893e0726079fcddd51b6a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,123 INFO [IPC Server handler 1 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:23,124 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:23,134 INFO [StoreOpener-5083515e811013bc2a8be90523d4a81a-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:23,142 INFO [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(630): Onlined 5083515e811013bc2a8be90523d4a81a; next sequenceid=1 2013-08-29 22:15:23,142 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,142 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 5083515e811013bc2a8be90523d4a81a 2013-08-29 22:15:23,145 INFO [RpcServer.handler=3,port=44745] master.AssignmentManager(1917): Assigning tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,145 INFO [RpcServer.handler=3,port=44745] master.RegionStates(263): Transitioned from {63449e4bed174f301e94011ae27a579b state=OFFLINE, ts=1377814523114, server=null} to {63449e4bed174f301e94011ae27a579b state=PENDING_OPEN, ts=1377814523145, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,146 INFO [PostOpenDeployTasks:5083515e811013bc2a8be90523d4a81a] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:23,146 INFO [RpcServer.handler=2,port=57016] regionserver.HRegionServer(3521): Open tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:15:23,176 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e27461887c1893e0726079fcddd51b6a 2013-08-29 22:15:23,177 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node e27461887c1893e0726079fcddd51b6a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,177 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(376): Transitioned e27461887c1893e0726079fcddd51b6a to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,177 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(186): Opened tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,178 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=e27461887c1893e0726079fcddd51b6a, current state from region state map ={e27461887c1893e0726079fcddd51b6a state=OPENING, ts=1377814522539, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,179 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates(263): Transitioned from {e27461887c1893e0726079fcddd51b6a state=OPENING, ts=1377814522539, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {e27461887c1893e0726079fcddd51b6a state=OPEN, ts=1377814523179, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,179 DEBUG [AM.ZK.Worker-pool2-t12] handler.OpenedRegionHandler(150): Handling OPENED event for e27461887c1893e0726079fcddd51b6a from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:23,179 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node e27461887c1893e0726079fcddd51b6a in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,183 INFO [PostOpenDeployTasks:5083515e811013bc2a8be90523d4a81a] catalog.MetaEditor(462): Updated row tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,183 INFO [PostOpenDeployTasks:5083515e811013bc2a8be90523d4a81a] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:23,184 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 5083515e811013bc2a8be90523d4a81a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,185 INFO [RpcServer.handler=1,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:15:23,186 DEBUG [RpcServer.handler=1,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. so generated a random one; hri=tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:23,186 DEBUG [RpcServer.handler=1,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 80313bc36e51c8a392f5a074bc08d6e9 with OFFLINE state 2013-08-29 22:15:23,200 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/e27461887c1893e0726079fcddd51b6a 2013-08-29 22:15:23,200 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,201 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node e27461887c1893e0726079fcddd51b6a in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,201 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager$4(1276): Znode tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. deleted, state: {e27461887c1893e0726079fcddd51b6a state=OPEN, ts=1377814523179, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,202 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates(299): Onlined e27461887c1893e0726079fcddd51b6a on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,225 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5083515e811013bc2a8be90523d4a81a 2013-08-29 22:15:23,225 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 5083515e811013bc2a8be90523d4a81a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,226 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(376): Transitioned 5083515e811013bc2a8be90523d4a81a to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,226 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(186): Opened tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,248 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,249 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:23,251 DEBUG [AM.ZK.Worker-pool2-t10] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=5083515e811013bc2a8be90523d4a81a, current state from region state map ={5083515e811013bc2a8be90523d4a81a state=OPENING, ts=1377814522679, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,251 INFO [AM.ZK.Worker-pool2-t10] master.RegionStates(263): Transitioned from {5083515e811013bc2a8be90523d4a81a state=OPENING, ts=1377814522679, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {5083515e811013bc2a8be90523d4a81a state=OPEN, ts=1377814523251, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,251 DEBUG [AM.ZK.Worker-pool2-t10] handler.OpenedRegionHandler(150): Handling OPENED event for 5083515e811013bc2a8be90523d4a81a from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:23,252 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:23,252 DEBUG [AM.ZK.Worker-pool2-t10] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 5083515e811013bc2a8be90523d4a81a in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,252 INFO [RpcServer.handler=1,port=44745] master.AssignmentManager(1917): Assigning tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,253 INFO [RpcServer.handler=1,port=44745] master.RegionStates(263): Transitioned from {80313bc36e51c8a392f5a074bc08d6e9 state=OFFLINE, ts=1377814523186, server=null} to {80313bc36e51c8a392f5a074bc08d6e9 state=PENDING_OPEN, ts=1377814523253, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,253 INFO [RpcServer.handler=3,port=57016] regionserver.HRegionServer(3521): Open tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:15:23,276 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/5083515e811013bc2a8be90523d4a81a 2013-08-29 22:15:23,276 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,277 DEBUG [AM.ZK.Worker-pool2-t10] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 5083515e811013bc2a8be90523d4a81a in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,277 DEBUG [AM.ZK.Worker-pool2-t10] master.AssignmentManager$4(1276): Znode tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. deleted, state: {5083515e811013bc2a8be90523d4a81a state=OPEN, ts=1377814523251, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,278 INFO [AM.ZK.Worker-pool2-t10] master.RegionStates(299): Onlined 5083515e811013bc2a8be90523d4a81a on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,283 INFO [RpcServer.handler=0,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:15:23,283 DEBUG [RpcServer.handler=0,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. so generated a random one; hri=tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:23,283 DEBUG [RpcServer.handler=0,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 407a01405eb76853035e2d90869eecf0 with OFFLINE state 2013-08-29 22:15:23,288 INFO [StoreOpener-725a1977cc9ede4514e8029d5522b6ee-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:23,295 INFO [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(630): Onlined 725a1977cc9ede4514e8029d5522b6ee; next sequenceid=1 2013-08-29 22:15:23,295 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 725a1977cc9ede4514e8029d5522b6ee 2013-08-29 22:15:23,343 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,344 INFO [PostOpenDeployTasks:725a1977cc9ede4514e8029d5522b6ee] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:23,346 INFO [RpcServer.handler=0,port=44745] master.AssignmentManager(1917): Assigning tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,346 INFO [RpcServer.handler=0,port=44745] master.RegionStates(263): Transitioned from {407a01405eb76853035e2d90869eecf0 state=OFFLINE, ts=1377814523283, server=null} to {407a01405eb76853035e2d90869eecf0 state=PENDING_OPEN, ts=1377814523346, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,347 INFO [RpcServer.handler=4,port=57016] regionserver.HRegionServer(3521): Open tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:15:23,357 INFO [RpcServer.handler=4,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:23,357 DEBUG [RpcServer.handler=4,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. so generated a random one; hri=tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:23,357 DEBUG [RpcServer.handler=4,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 12d9a59d636d44af012cc60809b2e9ad with OFFLINE state 2013-08-29 22:15:23,370 INFO [PostOpenDeployTasks:725a1977cc9ede4514e8029d5522b6ee] catalog.MetaEditor(462): Updated row tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,370 INFO [PostOpenDeployTasks:725a1977cc9ede4514e8029d5522b6ee] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:23,371 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 725a1977cc9ede4514e8029d5522b6ee from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,417 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,418 INFO [StoreOpener-60dd6b689221b85fed89c65d2cfd13b2-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:23,420 INFO [RpcServer.handler=4,port=44745] master.AssignmentManager(1917): Assigning tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,420 INFO [RpcServer.handler=4,port=44745] master.RegionStates(263): Transitioned from {12d9a59d636d44af012cc60809b2e9ad state=OFFLINE, ts=1377814523357, server=null} to {12d9a59d636d44af012cc60809b2e9ad state=PENDING_OPEN, ts=1377814523420, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,421 INFO [RpcServer.handler=2,port=51291] regionserver.HRegionServer(3521): Open tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:23,425 INFO [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(630): Onlined 60dd6b689221b85fed89c65d2cfd13b2; next sequenceid=1 2013-08-29 22:15:23,425 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 60dd6b689221b85fed89c65d2cfd13b2 2013-08-29 22:15:23,453 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/725a1977cc9ede4514e8029d5522b6ee 2013-08-29 22:15:23,453 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 725a1977cc9ede4514e8029d5522b6ee from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,453 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(376): Transitioned 725a1977cc9ede4514e8029d5522b6ee to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,453 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(186): Opened tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,454 INFO [PostOpenDeployTasks:60dd6b689221b85fed89c65d2cfd13b2] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:15:23,455 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 12d9a59d636d44af012cc60809b2e9ad from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,456 DEBUG [AM.ZK.Worker-pool2-t3] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=725a1977cc9ede4514e8029d5522b6ee, current state from region state map ={725a1977cc9ede4514e8029d5522b6ee state=OPENING, ts=1377814522817, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,456 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates(263): Transitioned from {725a1977cc9ede4514e8029d5522b6ee state=OPENING, ts=1377814522817, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {725a1977cc9ede4514e8029d5522b6ee state=OPEN, ts=1377814523456, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,456 DEBUG [AM.ZK.Worker-pool2-t3] handler.OpenedRegionHandler(150): Handling OPENED event for 725a1977cc9ede4514e8029d5522b6ee from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:23,457 DEBUG [AM.ZK.Worker-pool2-t3] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 725a1977cc9ede4514e8029d5522b6ee in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,523 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/12d9a59d636d44af012cc60809b2e9ad 2013-08-29 22:15:23,524 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 12d9a59d636d44af012cc60809b2e9ad from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,527 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(4085): Opening region: {ENCODED => 12d9a59d636d44af012cc60809b2e9ad, NAME => 'tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2013-08-29 22:15:23,528 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 12d9a59d636d44af012cc60809b2e9ad 2013-08-29 22:15:23,529 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(535): Instantiated tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:23,529 INFO [RpcServer.handler=3,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:15:23,529 DEBUG [AM.ZK.Worker-pool2-t1] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=12d9a59d636d44af012cc60809b2e9ad, current state from region state map ={12d9a59d636d44af012cc60809b2e9ad state=PENDING_OPEN, ts=1377814523420, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,529 DEBUG [RpcServer.handler=3,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. so generated a random one; hri=tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:23,529 INFO [AM.ZK.Worker-pool2-t1] master.RegionStates(263): Transitioned from {12d9a59d636d44af012cc60809b2e9ad state=PENDING_OPEN, ts=1377814523420, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {12d9a59d636d44af012cc60809b2e9ad state=OPENING, ts=1377814523529, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,530 DEBUG [RpcServer.handler=3,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 68a7538716d8db76c6342305e700744b with OFFLINE state 2013-08-29 22:15:23,530 INFO [PostOpenDeployTasks:60dd6b689221b85fed89c65d2cfd13b2] catalog.MetaEditor(462): Updated row tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,530 INFO [PostOpenDeployTasks:60dd6b689221b85fed89c65d2cfd13b2] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:15:23,531 WARN [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 12d9a59d636d44af012cc60809b2e9ad 2013-08-29 22:15:23,531 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 60dd6b689221b85fed89c65d2cfd13b2 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,564 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/725a1977cc9ede4514e8029d5522b6ee 2013-08-29 22:15:23,564 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,565 DEBUG [AM.ZK.Worker-pool2-t3] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 725a1977cc9ede4514e8029d5522b6ee in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,565 DEBUG [AM.ZK.Worker-pool2-t3] master.AssignmentManager$4(1276): Znode tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. deleted, state: {725a1977cc9ede4514e8029d5522b6ee state=OPEN, ts=1377814523456, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,565 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates(299): Onlined 725a1977cc9ede4514e8029d5522b6ee on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,585 INFO [StoreOpener-16d9fd46b6932e1be21e5e7f4dd79ac4-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:23,592 INFO [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(630): Onlined 16d9fd46b6932e1be21e5e7f4dd79ac4; next sequenceid=1 2013-08-29 22:15:23,593 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 16d9fd46b6932e1be21e5e7f4dd79ac4 2013-08-29 22:15:23,593 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:23,595 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741852_1028 size 48 2013-08-29 22:15:23,597 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/60dd6b689221b85fed89c65d2cfd13b2 2013-08-29 22:15:23,597 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 60dd6b689221b85fed89c65d2cfd13b2 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,597 DEBUG [RS_OPEN_REGION-kiyo:57016-1] handler.OpenRegionHandler(376): Transitioned 60dd6b689221b85fed89c65d2cfd13b2 to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,598 DEBUG [RS_OPEN_REGION-kiyo:57016-1] handler.OpenRegionHandler(186): Opened tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,598 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 63449e4bed174f301e94011ae27a579b from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,634 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,636 INFO [PostOpenDeployTasks:16d9fd46b6932e1be21e5e7f4dd79ac4] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:15:23,636 DEBUG [AM.ZK.Worker-pool2-t2] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=60dd6b689221b85fed89c65d2cfd13b2, current state from region state map ={60dd6b689221b85fed89c65d2cfd13b2 state=OPENING, ts=1377814522910, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,636 INFO [AM.ZK.Worker-pool2-t2] master.RegionStates(263): Transitioned from {60dd6b689221b85fed89c65d2cfd13b2 state=OPENING, ts=1377814522910, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {60dd6b689221b85fed89c65d2cfd13b2 state=OPEN, ts=1377814523636, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,636 DEBUG [AM.ZK.Worker-pool2-t2] handler.OpenedRegionHandler(150): Handling OPENED event for 60dd6b689221b85fed89c65d2cfd13b2 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:23,637 DEBUG [AM.ZK.Worker-pool2-t2] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 60dd6b689221b85fed89c65d2cfd13b2 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,642 INFO [RpcServer.handler=3,port=44745] master.AssignmentManager(1917): Assigning tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,642 INFO [RpcServer.handler=3,port=44745] master.RegionStates(263): Transitioned from {68a7538716d8db76c6342305e700744b state=OFFLINE, ts=1377814523530, server=null} to {68a7538716d8db76c6342305e700744b state=PENDING_OPEN, ts=1377814523642, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,643 INFO [RpcServer.handler=0,port=57016] regionserver.HRegionServer(3521): Open tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:15:23,681 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/63449e4bed174f301e94011ae27a579b 2013-08-29 22:15:23,681 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 63449e4bed174f301e94011ae27a579b from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,681 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(4085): Opening region: {ENCODED => 63449e4bed174f301e94011ae27a579b, NAME => 'tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2013-08-29 22:15:23,681 INFO [StoreOpener-e0f77722c886c7dbde9efcde4f60c2c6-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:23,682 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 63449e4bed174f301e94011ae27a579b 2013-08-29 22:15:23,683 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(535): Instantiated tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:15:23,684 DEBUG [AM.ZK.Worker-pool2-t11] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=63449e4bed174f301e94011ae27a579b, current state from region state map ={63449e4bed174f301e94011ae27a579b state=PENDING_OPEN, ts=1377814523145, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,684 INFO [AM.ZK.Worker-pool2-t11] master.RegionStates(263): Transitioned from {63449e4bed174f301e94011ae27a579b state=PENDING_OPEN, ts=1377814523145, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {63449e4bed174f301e94011ae27a579b state=OPENING, ts=1377814523684, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,685 WARN [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 63449e4bed174f301e94011ae27a579b 2013-08-29 22:15:23,685 INFO [PostOpenDeployTasks:16d9fd46b6932e1be21e5e7f4dd79ac4] catalog.MetaEditor(462): Updated row tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,686 INFO [PostOpenDeployTasks:16d9fd46b6932e1be21e5e7f4dd79ac4] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:15:23,686 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 16d9fd46b6932e1be21e5e7f4dd79ac4 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,729 INFO [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(630): Onlined e0f77722c886c7dbde9efcde4f60c2c6; next sequenceid=1 2013-08-29 22:15:23,730 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node e0f77722c886c7dbde9efcde4f60c2c6 2013-08-29 22:15:23,736 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/60dd6b689221b85fed89c65d2cfd13b2 2013-08-29 22:15:23,738 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,740 DEBUG [AM.ZK.Worker-pool2-t2] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 60dd6b689221b85fed89c65d2cfd13b2 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,740 DEBUG [AM.ZK.Worker-pool2-t2] master.AssignmentManager$4(1276): Znode tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. deleted, state: {60dd6b689221b85fed89c65d2cfd13b2 state=OPEN, ts=1377814523636, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,740 INFO [AM.ZK.Worker-pool2-t2] master.RegionStates(299): Onlined 60dd6b689221b85fed89c65d2cfd13b2 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,741 INFO [RpcServer.handler=2,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:23,742 DEBUG [RpcServer.handler=2,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. so generated a random one; hri=tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:23,742 DEBUG [RpcServer.handler=2,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node e7bde0f77848062af569d79f61a83b4c with OFFLINE state 2013-08-29 22:15:23,742 INFO [PostOpenDeployTasks:e0f77722c886c7dbde9efcde4f60c2c6] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:15:23,781 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/16d9fd46b6932e1be21e5e7f4dd79ac4 2013-08-29 22:15:23,781 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 16d9fd46b6932e1be21e5e7f4dd79ac4 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,781 DEBUG [RS_OPEN_REGION-kiyo:57016-2] handler.OpenRegionHandler(376): Transitioned 16d9fd46b6932e1be21e5e7f4dd79ac4 to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,781 DEBUG [RS_OPEN_REGION-kiyo:57016-2] handler.OpenRegionHandler(186): Opened tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,782 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 80313bc36e51c8a392f5a074bc08d6e9 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,785 DEBUG [AM.ZK.Worker-pool2-t9] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=16d9fd46b6932e1be21e5e7f4dd79ac4, current state from region state map ={16d9fd46b6932e1be21e5e7f4dd79ac4 state=OPENING, ts=1377814523009, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,786 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates(263): Transitioned from {16d9fd46b6932e1be21e5e7f4dd79ac4 state=OPENING, ts=1377814523009, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {16d9fd46b6932e1be21e5e7f4dd79ac4 state=OPEN, ts=1377814523785, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,786 DEBUG [AM.ZK.Worker-pool2-t9] handler.OpenedRegionHandler(150): Handling OPENED event for 16d9fd46b6932e1be21e5e7f4dd79ac4 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:23,786 DEBUG [AM.ZK.Worker-pool2-t9] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 16d9fd46b6932e1be21e5e7f4dd79ac4 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,788 INFO [PostOpenDeployTasks:e0f77722c886c7dbde9efcde4f60c2c6] catalog.MetaEditor(462): Updated row tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,788 INFO [PostOpenDeployTasks:e0f77722c886c7dbde9efcde4f60c2c6] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:15:23,788 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning e0f77722c886c7dbde9efcde4f60c2c6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,799 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:23,801 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741853_1029 size 48 2013-08-29 22:15:23,857 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/80313bc36e51c8a392f5a074bc08d6e9 2013-08-29 22:15:23,858 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 80313bc36e51c8a392f5a074bc08d6e9 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,858 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(4085): Opening region: {ENCODED => 80313bc36e51c8a392f5a074bc08d6e9, NAME => 'tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2013-08-29 22:15:23,859 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 80313bc36e51c8a392f5a074bc08d6e9 2013-08-29 22:15:23,860 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(535): Instantiated tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:15:23,861 WARN [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 80313bc36e51c8a392f5a074bc08d6e9 2013-08-29 22:15:23,883 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,887 DEBUG [AM.ZK.Worker-pool2-t16] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=80313bc36e51c8a392f5a074bc08d6e9, current state from region state map ={80313bc36e51c8a392f5a074bc08d6e9 state=PENDING_OPEN, ts=1377814523253, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,887 INFO [AM.ZK.Worker-pool2-t16] master.RegionStates(263): Transitioned from {80313bc36e51c8a392f5a074bc08d6e9 state=PENDING_OPEN, ts=1377814523253, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {80313bc36e51c8a392f5a074bc08d6e9 state=OPENING, ts=1377814523887, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,888 INFO [RpcServer.handler=2,port=44745] master.AssignmentManager(1917): Assigning tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:23,888 INFO [RpcServer.handler=2,port=44745] master.RegionStates(263): Transitioned from {e7bde0f77848062af569d79f61a83b4c state=OFFLINE, ts=1377814523742, server=null} to {e7bde0f77848062af569d79f61a83b4c state=PENDING_OPEN, ts=1377814523888, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:23,889 INFO [RpcServer.handler=3,port=51291] regionserver.HRegionServer(3521): Open tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:23,927 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e0f77722c886c7dbde9efcde4f60c2c6 2013-08-29 22:15:23,928 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node e0f77722c886c7dbde9efcde4f60c2c6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:23,928 DEBUG [RS_OPEN_REGION-kiyo:57016-0] handler.OpenRegionHandler(376): Transitioned e0f77722c886c7dbde9efcde4f60c2c6 to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,928 DEBUG [RS_OPEN_REGION-kiyo:57016-0] handler.OpenRegionHandler(186): Opened tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,928 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 407a01405eb76853035e2d90869eecf0 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,972 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/16d9fd46b6932e1be21e5e7f4dd79ac4 2013-08-29 22:15:23,972 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:23,973 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning e7bde0f77848062af569d79f61a83b4c from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:23,974 DEBUG [AM.ZK.Worker-pool2-t9] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 16d9fd46b6932e1be21e5e7f4dd79ac4 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,975 DEBUG [AM.ZK.Worker-pool2-t9] master.AssignmentManager$4(1276): Znode tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. deleted, state: {16d9fd46b6932e1be21e5e7f4dd79ac4 state=OPEN, ts=1377814523785, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,975 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates(299): Onlined 16d9fd46b6932e1be21e5e7f4dd79ac4 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:23,976 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=e0f77722c886c7dbde9efcde4f60c2c6, current state from region state map ={e0f77722c886c7dbde9efcde4f60c2c6 state=OPENING, ts=1377814523112, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,976 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates(263): Transitioned from {e0f77722c886c7dbde9efcde4f60c2c6 state=OPENING, ts=1377814523112, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {e0f77722c886c7dbde9efcde4f60c2c6 state=OPEN, ts=1377814523976, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:23,977 DEBUG [AM.ZK.Worker-pool2-t12] handler.OpenedRegionHandler(150): Handling OPENED event for e0f77722c886c7dbde9efcde4f60c2c6 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:23,977 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node e0f77722c886c7dbde9efcde4f60c2c6 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:23,979 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:23,980 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:24,019 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/407a01405eb76853035e2d90869eecf0 2013-08-29 22:15:24,020 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 407a01405eb76853035e2d90869eecf0 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,020 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(4085): Opening region: {ENCODED => 407a01405eb76853035e2d90869eecf0, NAME => 'tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2013-08-29 22:15:24,021 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 407a01405eb76853035e2d90869eecf0 2013-08-29 22:15:24,022 DEBUG [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(535): Instantiated tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:15:24,024 INFO [RpcServer.handler=0,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:15:24,025 DEBUG [AM.ZK.Worker-pool2-t4] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=407a01405eb76853035e2d90869eecf0, current state from region state map ={407a01405eb76853035e2d90869eecf0 state=PENDING_OPEN, ts=1377814523346, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,025 DEBUG [RpcServer.handler=0,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. so generated a random one; hri=tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217., src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:24,025 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates(263): Transitioned from {407a01405eb76853035e2d90869eecf0 state=PENDING_OPEN, ts=1377814523346, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {407a01405eb76853035e2d90869eecf0 state=OPENING, ts=1377814524025, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,025 DEBUG [RpcServer.handler=0,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node e216da715f0e1cbfad4a22d737c61217 with OFFLINE state 2013-08-29 22:15:24,060 WARN [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 407a01405eb76853035e2d90869eecf0 2013-08-29 22:15:24,066 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e7bde0f77848062af569d79f61a83b4c 2013-08-29 22:15:24,067 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node e7bde0f77848062af569d79f61a83b4c from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,067 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(4085): Opening region: {ENCODED => e7bde0f77848062af569d79f61a83b4c, NAME => 'tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c.', STARTKEY => 'vvv', ENDKEY => 'www'} 2013-08-29 22:15:24,068 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest e7bde0f77848062af569d79f61a83b4c 2013-08-29 22:15:24,068 DEBUG [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(535): Instantiated tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:24,070 WARN [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: e7bde0f77848062af569d79f61a83b4c 2013-08-29 22:15:24,082 INFO [StoreOpener-12d9a59d636d44af012cc60809b2e9ad-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,088 INFO [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(630): Onlined 12d9a59d636d44af012cc60809b2e9ad; next sequenceid=1 2013-08-29 22:15:24,089 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 12d9a59d636d44af012cc60809b2e9ad 2013-08-29 22:15:24,097 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/e0f77722c886c7dbde9efcde4f60c2c6 2013-08-29 22:15:24,097 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,097 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node e0f77722c886c7dbde9efcde4f60c2c6 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,098 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager$4(1276): Znode tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. deleted, state: {e0f77722c886c7dbde9efcde4f60c2c6 state=OPEN, ts=1377814523976, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,098 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates(299): Onlined e0f77722c886c7dbde9efcde4f60c2c6 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,099 INFO [PostOpenDeployTasks:12d9a59d636d44af012cc60809b2e9ad] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:24,099 DEBUG [AM.ZK.Worker-pool2-t10] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=e7bde0f77848062af569d79f61a83b4c, current state from region state map ={e7bde0f77848062af569d79f61a83b4c state=PENDING_OPEN, ts=1377814523888, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,099 INFO [AM.ZK.Worker-pool2-t10] master.RegionStates(263): Transitioned from {e7bde0f77848062af569d79f61a83b4c state=PENDING_OPEN, ts=1377814523888, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {e7bde0f77848062af569d79f61a83b4c state=OPENING, ts=1377814524099, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,125 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:24,126 INFO [IPC Server handler 6 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741855_1031 size 48 2013-08-29 22:15:24,130 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,133 INFO [RpcServer.handler=0,port=44745] master.AssignmentManager(1917): Assigning tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,133 INFO [RpcServer.handler=0,port=44745] master.RegionStates(263): Transitioned from {e216da715f0e1cbfad4a22d737c61217 state=OFFLINE, ts=1377814524025, server=null} to {e216da715f0e1cbfad4a22d737c61217 state=PENDING_OPEN, ts=1377814524133, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,134 INFO [RpcServer.handler=1,port=57016] regionserver.HRegionServer(3521): Open tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:15:24,135 INFO [PostOpenDeployTasks:12d9a59d636d44af012cc60809b2e9ad] catalog.MetaEditor(462): Updated row tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,136 INFO [PostOpenDeployTasks:12d9a59d636d44af012cc60809b2e9ad] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:24,136 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:24,136 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 12d9a59d636d44af012cc60809b2e9ad from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,137 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741856_1032 size 48 2013-08-29 22:15:24,155 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/12d9a59d636d44af012cc60809b2e9ad 2013-08-29 22:15:24,155 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 12d9a59d636d44af012cc60809b2e9ad from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,155 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(376): Transitioned 12d9a59d636d44af012cc60809b2e9ad to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,155 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(186): Opened tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,156 DEBUG [AM.ZK.Worker-pool2-t1] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=12d9a59d636d44af012cc60809b2e9ad, current state from region state map ={12d9a59d636d44af012cc60809b2e9ad state=OPENING, ts=1377814523529, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,156 INFO [AM.ZK.Worker-pool2-t1] master.RegionStates(263): Transitioned from {12d9a59d636d44af012cc60809b2e9ad state=OPENING, ts=1377814523529, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {12d9a59d636d44af012cc60809b2e9ad state=OPEN, ts=1377814524156, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,157 DEBUG [AM.ZK.Worker-pool2-t1] handler.OpenedRegionHandler(150): Handling OPENED event for 12d9a59d636d44af012cc60809b2e9ad from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:24,157 DEBUG [AM.ZK.Worker-pool2-t1] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 12d9a59d636d44af012cc60809b2e9ad in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,161 INFO [RpcServer.handler=1,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:24,161 DEBUG [RpcServer.handler=1,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. so generated a random one; hri=tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:24,161 DEBUG [RpcServer.handler=1,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 1bebce232a6486e349b4548a81ce3c34 with OFFLINE state 2013-08-29 22:15:24,186 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/12d9a59d636d44af012cc60809b2e9ad 2013-08-29 22:15:24,187 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,187 INFO [StoreOpener-63449e4bed174f301e94011ae27a579b-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,187 DEBUG [AM.ZK.Worker-pool2-t1] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 12d9a59d636d44af012cc60809b2e9ad in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,188 DEBUG [AM.ZK.Worker-pool2-t1] master.AssignmentManager$4(1276): Znode tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. deleted, state: {12d9a59d636d44af012cc60809b2e9ad state=OPEN, ts=1377814524156, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,188 INFO [AM.ZK.Worker-pool2-t1] master.RegionStates(299): Onlined 12d9a59d636d44af012cc60809b2e9ad on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,192 INFO [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(630): Onlined 63449e4bed174f301e94011ae27a579b; next sequenceid=1 2013-08-29 22:15:24,192 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 63449e4bed174f301e94011ae27a579b 2013-08-29 22:15:24,216 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,217 INFO [PostOpenDeployTasks:63449e4bed174f301e94011ae27a579b] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:15:24,218 INFO [RpcServer.handler=1,port=44745] master.AssignmentManager(1917): Assigning tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,218 INFO [RpcServer.handler=1,port=44745] master.RegionStates(263): Transitioned from {1bebce232a6486e349b4548a81ce3c34 state=OFFLINE, ts=1377814524161, server=null} to {1bebce232a6486e349b4548a81ce3c34 state=PENDING_OPEN, ts=1377814524218, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,219 INFO [RpcServer.handler=4,port=51291] regionserver.HRegionServer(3521): Open tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:24,223 INFO [PostOpenDeployTasks:63449e4bed174f301e94011ae27a579b] catalog.MetaEditor(462): Updated row tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,223 INFO [PostOpenDeployTasks:63449e4bed174f301e94011ae27a579b] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:15:24,224 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 63449e4bed174f301e94011ae27a579b from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,240 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/63449e4bed174f301e94011ae27a579b 2013-08-29 22:15:24,240 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 63449e4bed174f301e94011ae27a579b from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,241 DEBUG [RS_OPEN_REGION-kiyo:57016-1] handler.OpenRegionHandler(376): Transitioned 63449e4bed174f301e94011ae27a579b to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,241 DEBUG [RS_OPEN_REGION-kiyo:57016-1] handler.OpenRegionHandler(186): Opened tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,241 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 68a7538716d8db76c6342305e700744b from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,242 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 1bebce232a6486e349b4548a81ce3c34 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,247 DEBUG [AM.ZK.Worker-pool2-t6] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=63449e4bed174f301e94011ae27a579b, current state from region state map ={63449e4bed174f301e94011ae27a579b state=OPENING, ts=1377814523684, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,247 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates(263): Transitioned from {63449e4bed174f301e94011ae27a579b state=OPENING, ts=1377814523684, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {63449e4bed174f301e94011ae27a579b state=OPEN, ts=1377814524247, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,247 DEBUG [AM.ZK.Worker-pool2-t6] handler.OpenedRegionHandler(150): Handling OPENED event for 63449e4bed174f301e94011ae27a579b from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:24,247 DEBUG [AM.ZK.Worker-pool2-t6] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 63449e4bed174f301e94011ae27a579b in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,305 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1bebce232a6486e349b4548a81ce3c34 2013-08-29 22:15:24,305 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 1bebce232a6486e349b4548a81ce3c34 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,306 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(4085): Opening region: {ENCODED => 1bebce232a6486e349b4548a81ce3c34, NAME => 'tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2013-08-29 22:15:24,306 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 1bebce232a6486e349b4548a81ce3c34 2013-08-29 22:15:24,307 DEBUG [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(535): Instantiated tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:24,315 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/68a7538716d8db76c6342305e700744b 2013-08-29 22:15:24,316 INFO [StoreOpener-80313bc36e51c8a392f5a074bc08d6e9-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,316 WARN [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 1bebce232a6486e349b4548a81ce3c34 2013-08-29 22:15:24,317 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 68a7538716d8db76c6342305e700744b from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,317 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(4085): Opening region: {ENCODED => 68a7538716d8db76c6342305e700744b, NAME => 'tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2013-08-29 22:15:24,317 DEBUG [AM.ZK.Worker-pool2-t11] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=1bebce232a6486e349b4548a81ce3c34, current state from region state map ={1bebce232a6486e349b4548a81ce3c34 state=PENDING_OPEN, ts=1377814524218, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,318 INFO [AM.ZK.Worker-pool2-t11] master.RegionStates(263): Transitioned from {1bebce232a6486e349b4548a81ce3c34 state=PENDING_OPEN, ts=1377814524218, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {1bebce232a6486e349b4548a81ce3c34 state=OPENING, ts=1377814524318, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,318 DEBUG [AM.ZK.Worker-pool2-t8] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=68a7538716d8db76c6342305e700744b, current state from region state map ={68a7538716d8db76c6342305e700744b state=PENDING_OPEN, ts=1377814523642, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,318 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 68a7538716d8db76c6342305e700744b 2013-08-29 22:15:24,318 INFO [AM.ZK.Worker-pool2-t8] master.RegionStates(263): Transitioned from {68a7538716d8db76c6342305e700744b state=PENDING_OPEN, ts=1377814523642, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {68a7538716d8db76c6342305e700744b state=OPENING, ts=1377814524318, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,318 DEBUG [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(535): Instantiated tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:15:24,318 INFO [RpcServer.handler=4,port=44745] master.HMaster(2541): Client=hortonzy//68.142.244.61 assign tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:24,319 DEBUG [RpcServer.handler=4,port=44745] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. so generated a random one; hri=tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8., src=, dest=kiyo.gq1.ygridcore.net,51291,1377814509998; 2 (online=2, available=2) available servers, forceNewPlan=true 2013-08-29 22:15:24,319 DEBUG [RpcServer.handler=4,port=44745] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 1da0a8c300279c072ba5f6fd9c3317d8 with OFFLINE state 2013-08-29 22:15:24,320 WARN [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 68a7538716d8db76c6342305e700744b 2013-08-29 22:15:24,322 INFO [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(630): Onlined 80313bc36e51c8a392f5a074bc08d6e9; next sequenceid=1 2013-08-29 22:15:24,322 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 80313bc36e51c8a392f5a074bc08d6e9 2013-08-29 22:15:24,332 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/63449e4bed174f301e94011ae27a579b 2013-08-29 22:15:24,332 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,333 DEBUG [AM.ZK.Worker-pool2-t6] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 63449e4bed174f301e94011ae27a579b in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,333 DEBUG [AM.ZK.Worker-pool2-t6] master.AssignmentManager$4(1276): Znode tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. deleted, state: {63449e4bed174f301e94011ae27a579b state=OPEN, ts=1377814524247, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,333 INFO [PostOpenDeployTasks:80313bc36e51c8a392f5a074bc08d6e9] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:15:24,333 INFO [AM.ZK.Worker-pool2-t6] master.RegionStates(299): Onlined 63449e4bed174f301e94011ae27a579b on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,348 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,351 INFO [RpcServer.handler=4,port=44745] master.AssignmentManager(1917): Assigning tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,351 INFO [RpcServer.handler=4,port=44745] master.RegionStates(263): Transitioned from {1da0a8c300279c072ba5f6fd9c3317d8 state=OFFLINE, ts=1377814524319, server=null} to {1da0a8c300279c072ba5f6fd9c3317d8 state=PENDING_OPEN, ts=1377814524351, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,352 INFO [RpcServer.handler=0,port=51291] regionserver.HRegionServer(3521): Open tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:24,352 INFO [PostOpenDeployTasks:80313bc36e51c8a392f5a074bc08d6e9] catalog.MetaEditor(462): Updated row tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,352 INFO [PostOpenDeployTasks:80313bc36e51c8a392f5a074bc08d6e9] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:15:24,353 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 80313bc36e51c8a392f5a074bc08d6e9 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,355 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 1da0a8c300279c072ba5f6fd9c3317d8 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,357 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:24,358 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741858_1034 size 48 2013-08-29 22:15:24,359 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741857_1033{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 48 2013-08-29 22:15:24,360 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741857_1033 size 48 2013-08-29 22:15:24,365 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/80313bc36e51c8a392f5a074bc08d6e9 2013-08-29 22:15:24,365 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 80313bc36e51c8a392f5a074bc08d6e9 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,366 INFO [StoreOpener-407a01405eb76853035e2d90869eecf0-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,366 INFO [StoreOpener-e7bde0f77848062af569d79f61a83b4c-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,366 DEBUG [RS_OPEN_REGION-kiyo:57016-2] handler.OpenRegionHandler(376): Transitioned 80313bc36e51c8a392f5a074bc08d6e9 to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,367 DEBUG [AM.ZK.Worker-pool2-t18] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=80313bc36e51c8a392f5a074bc08d6e9, current state from region state map ={80313bc36e51c8a392f5a074bc08d6e9 state=OPENING, ts=1377814523887, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,367 DEBUG [RS_OPEN_REGION-kiyo:57016-2] handler.OpenRegionHandler(186): Opened tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,367 INFO [AM.ZK.Worker-pool2-t18] master.RegionStates(263): Transitioned from {80313bc36e51c8a392f5a074bc08d6e9 state=OPENING, ts=1377814523887, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {80313bc36e51c8a392f5a074bc08d6e9 state=OPEN, ts=1377814524367, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,367 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning e216da715f0e1cbfad4a22d737c61217 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,367 DEBUG [AM.ZK.Worker-pool2-t18] handler.OpenedRegionHandler(150): Handling OPENED event for 80313bc36e51c8a392f5a074bc08d6e9 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:24,368 DEBUG [AM.ZK.Worker-pool2-t18] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 80313bc36e51c8a392f5a074bc08d6e9 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,372 INFO [RS_OPEN_REGION-kiyo:57016-0] regionserver.HRegion(630): Onlined 407a01405eb76853035e2d90869eecf0; next sequenceid=1 2013-08-29 22:15:24,372 INFO [RS_OPEN_REGION-kiyo:51291-0] regionserver.HRegion(630): Onlined e7bde0f77848062af569d79f61a83b4c; next sequenceid=1 2013-08-29 22:15:24,372 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 407a01405eb76853035e2d90869eecf0 2013-08-29 22:15:24,372 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node e7bde0f77848062af569d79f61a83b4c 2013-08-29 22:15:24,429 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1da0a8c300279c072ba5f6fd9c3317d8 2013-08-29 22:15:24,431 DEBUG [AM.ZK.Worker-pool2-t19] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=1da0a8c300279c072ba5f6fd9c3317d8, current state from region state map ={1da0a8c300279c072ba5f6fd9c3317d8 state=PENDING_OPEN, ts=1377814524351, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,431 INFO [AM.ZK.Worker-pool2-t19] master.RegionStates(263): Transitioned from {1da0a8c300279c072ba5f6fd9c3317d8 state=PENDING_OPEN, ts=1377814524351, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {1da0a8c300279c072ba5f6fd9c3317d8 state=OPENING, ts=1377814524431, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,431 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 1da0a8c300279c072ba5f6fd9c3317d8 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,432 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(4085): Opening region: {ENCODED => 1da0a8c300279c072ba5f6fd9c3317d8, NAME => 'tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8.', STARTKEY => 'yyy', ENDKEY => ''} 2013-08-29 22:15:24,433 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest 1da0a8c300279c072ba5f6fd9c3317d8 2013-08-29 22:15:24,433 INFO [PostOpenDeployTasks:407a01405eb76853035e2d90869eecf0] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:15:24,433 DEBUG [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(535): Instantiated tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:24,434 INFO [PostOpenDeployTasks:e7bde0f77848062af569d79f61a83b4c] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:24,453 WARN [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: 1da0a8c300279c072ba5f6fd9c3317d8 2013-08-29 22:15:24,476 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/80313bc36e51c8a392f5a074bc08d6e9 2013-08-29 22:15:24,476 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,477 DEBUG [AM.ZK.Worker-pool2-t18] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 80313bc36e51c8a392f5a074bc08d6e9 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,477 DEBUG [AM.ZK.Worker-pool2-t18] master.AssignmentManager$4(1276): Znode tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. deleted, state: {80313bc36e51c8a392f5a074bc08d6e9 state=OPEN, ts=1377814524367, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,477 INFO [AM.ZK.Worker-pool2-t18] master.RegionStates(299): Onlined 80313bc36e51c8a392f5a074bc08d6e9 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,496 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e216da715f0e1cbfad4a22d737c61217 2013-08-29 22:15:24,497 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node e216da715f0e1cbfad4a22d737c61217 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:24,498 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(4085): Opening region: {ENCODED => e216da715f0e1cbfad4a22d737c61217, NAME => 'tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217.', STARTKEY => 'www', ENDKEY => 'xxx'} 2013-08-29 22:15:24,498 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table tabletest e216da715f0e1cbfad4a22d737c61217 2013-08-29 22:15:24,498 DEBUG [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(535): Instantiated tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:15:24,499 DEBUG [AM.ZK.Worker-pool2-t4] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=e216da715f0e1cbfad4a22d737c61217, current state from region state map ={e216da715f0e1cbfad4a22d737c61217 state=PENDING_OPEN, ts=1377814524133, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,500 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates(263): Transitioned from {e216da715f0e1cbfad4a22d737c61217 state=PENDING_OPEN, ts=1377814524133, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {e216da715f0e1cbfad4a22d737c61217 state=OPENING, ts=1377814524500, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,500 WARN [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegionFileSystem(742): .regioninfo file not found for region: e216da715f0e1cbfad4a22d737c61217 2013-08-29 22:15:24,504 INFO [PostOpenDeployTasks:e7bde0f77848062af569d79f61a83b4c] catalog.MetaEditor(462): Updated row tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,504 INFO [PostOpenDeployTasks:e7bde0f77848062af569d79f61a83b4c] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:24,505 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning e7bde0f77848062af569d79f61a83b4c from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,505 INFO [PostOpenDeployTasks:407a01405eb76853035e2d90869eecf0] catalog.MetaEditor(462): Updated row tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,505 INFO [PostOpenDeployTasks:407a01405eb76853035e2d90869eecf0] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:15:24,507 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 407a01405eb76853035e2d90869eecf0 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,525 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:24,526 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741859_1035 size 45 2013-08-29 22:15:24,538 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e7bde0f77848062af569d79f61a83b4c 2013-08-29 22:15:24,538 DEBUG [RS_OPEN_REGION-kiyo:51291-0] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node e7bde0f77848062af569d79f61a83b4c from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,538 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(376): Transitioned e7bde0f77848062af569d79f61a83b4c to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,538 DEBUG [RS_OPEN_REGION-kiyo:51291-0] handler.OpenRegionHandler(186): Opened tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,568 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:24,569 INFO [IPC Server handler 6 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741860_1036 size 48 2013-08-29 22:15:24,580 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/407a01405eb76853035e2d90869eecf0 2013-08-29 22:15:24,580 DEBUG [RS_OPEN_REGION-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 407a01405eb76853035e2d90869eecf0 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,580 DEBUG [RS_OPEN_REGION-kiyo:57016-0] handler.OpenRegionHandler(376): Transitioned 407a01405eb76853035e2d90869eecf0 to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,580 DEBUG [RS_OPEN_REGION-kiyo:57016-0] handler.OpenRegionHandler(186): Opened tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,580 DEBUG [AM.ZK.Worker-pool2-t13] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=e7bde0f77848062af569d79f61a83b4c, current state from region state map ={e7bde0f77848062af569d79f61a83b4c state=OPENING, ts=1377814524099, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,580 INFO [AM.ZK.Worker-pool2-t13] master.RegionStates(263): Transitioned from {e7bde0f77848062af569d79f61a83b4c state=OPENING, ts=1377814524099, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {e7bde0f77848062af569d79f61a83b4c state=OPEN, ts=1377814524580, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,581 DEBUG [AM.ZK.Worker-pool2-t13] handler.OpenedRegionHandler(150): Handling OPENED event for e7bde0f77848062af569d79f61a83b4c from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:24,581 DEBUG [AM.ZK.Worker-pool2-t13] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node e7bde0f77848062af569d79f61a83b4c in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,581 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=407a01405eb76853035e2d90869eecf0, current state from region state map ={407a01405eb76853035e2d90869eecf0 state=OPENING, ts=1377814524025, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,581 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates(263): Transitioned from {407a01405eb76853035e2d90869eecf0 state=OPENING, ts=1377814524025, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {407a01405eb76853035e2d90869eecf0 state=OPEN, ts=1377814524581, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,581 DEBUG [AM.ZK.Worker-pool2-t12] handler.OpenedRegionHandler(150): Handling OPENED event for 407a01405eb76853035e2d90869eecf0 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:24,581 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 407a01405eb76853035e2d90869eecf0 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,605 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/e7bde0f77848062af569d79f61a83b4c 2013-08-29 22:15:24,605 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,605 DEBUG [AM.ZK.Worker-pool2-t13] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node e7bde0f77848062af569d79f61a83b4c in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,606 DEBUG [AM.ZK.Worker-pool2-t13] master.AssignmentManager$4(1276): Znode tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. deleted, state: {e7bde0f77848062af569d79f61a83b4c state=OPEN, ts=1377814524580, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,606 INFO [AM.ZK.Worker-pool2-t13] master.RegionStates(299): Onlined e7bde0f77848062af569d79f61a83b4c on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,606 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/407a01405eb76853035e2d90869eecf0 2013-08-29 22:15:24,606 DEBUG [AM.ZK.Worker-pool2-t12] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 407a01405eb76853035e2d90869eecf0 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,607 DEBUG [AM.ZK.Worker-pool2-t12] master.AssignmentManager$4(1276): Znode tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. deleted, state: {407a01405eb76853035e2d90869eecf0 state=OPEN, ts=1377814524581, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,607 INFO [AM.ZK.Worker-pool2-t12] master.RegionStates(299): Onlined 407a01405eb76853035e2d90869eecf0 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,619 INFO [StoreOpener-1bebce232a6486e349b4548a81ce3c34-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,625 INFO [RS_OPEN_REGION-kiyo:51291-1] regionserver.HRegion(630): Onlined 1bebce232a6486e349b4548a81ce3c34; next sequenceid=1 2013-08-29 22:15:24,626 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 1bebce232a6486e349b4548a81ce3c34 2013-08-29 22:15:24,628 INFO [PostOpenDeployTasks:1bebce232a6486e349b4548a81ce3c34] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:24,634 INFO [PostOpenDeployTasks:1bebce232a6486e349b4548a81ce3c34] catalog.MetaEditor(462): Updated row tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,634 INFO [PostOpenDeployTasks:1bebce232a6486e349b4548a81ce3c34] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:24,634 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 1bebce232a6486e349b4548a81ce3c34 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,663 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1bebce232a6486e349b4548a81ce3c34 2013-08-29 22:15:24,663 DEBUG [RS_OPEN_REGION-kiyo:51291-1] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 1bebce232a6486e349b4548a81ce3c34 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,663 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(376): Transitioned 1bebce232a6486e349b4548a81ce3c34 to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,663 DEBUG [RS_OPEN_REGION-kiyo:51291-1] handler.OpenRegionHandler(186): Opened tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,665 DEBUG [AM.ZK.Worker-pool2-t3] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=1bebce232a6486e349b4548a81ce3c34, current state from region state map ={1bebce232a6486e349b4548a81ce3c34 state=OPENING, ts=1377814524318, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,665 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates(263): Transitioned from {1bebce232a6486e349b4548a81ce3c34 state=OPENING, ts=1377814524318, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {1bebce232a6486e349b4548a81ce3c34 state=OPEN, ts=1377814524665, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,665 DEBUG [AM.ZK.Worker-pool2-t3] handler.OpenedRegionHandler(150): Handling OPENED event for 1bebce232a6486e349b4548a81ce3c34 from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:24,665 DEBUG [AM.ZK.Worker-pool2-t3] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 1bebce232a6486e349b4548a81ce3c34 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1bebce232a6486e349b4548a81ce3c34 2013-08-29 22:15:24,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,689 DEBUG [AM.ZK.Worker-pool2-t3] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 1bebce232a6486e349b4548a81ce3c34 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,689 DEBUG [AM.ZK.Worker-pool2-t3] master.AssignmentManager$4(1276): Znode tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. deleted, state: {1bebce232a6486e349b4548a81ce3c34 state=OPEN, ts=1377814524665, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,689 INFO [AM.ZK.Worker-pool2-t3] master.RegionStates(299): Onlined 1bebce232a6486e349b4548a81ce3c34 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,748 INFO [StoreOpener-1da0a8c300279c072ba5f6fd9c3317d8-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,754 INFO [RS_OPEN_REGION-kiyo:51291-2] regionserver.HRegion(630): Onlined 1da0a8c300279c072ba5f6fd9c3317d8; next sequenceid=1 2013-08-29 22:15:24,754 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(598): regionserver:51291-0x140cc24e86a0002 Attempting to retransition opening state of node 1da0a8c300279c072ba5f6fd9c3317d8 2013-08-29 22:15:24,756 INFO [PostOpenDeployTasks:1da0a8c300279c072ba5f6fd9c3317d8] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:24,763 INFO [PostOpenDeployTasks:1da0a8c300279c072ba5f6fd9c3317d8] catalog.MetaEditor(462): Updated row tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. with server=kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,763 INFO [PostOpenDeployTasks:1da0a8c300279c072ba5f6fd9c3317d8] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:24,763 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(786): regionserver:51291-0x140cc24e86a0002 Transitioning 1da0a8c300279c072ba5f6fd9c3317d8 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,773 INFO [StoreOpener-e216da715f0e1cbfad4a22d737c61217-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,780 INFO [RS_OPEN_REGION-kiyo:57016-2] regionserver.HRegion(630): Onlined e216da715f0e1cbfad4a22d737c61217; next sequenceid=1 2013-08-29 22:15:24,780 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node e216da715f0e1cbfad4a22d737c61217 2013-08-29 22:15:24,784 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1da0a8c300279c072ba5f6fd9c3317d8 2013-08-29 22:15:24,784 DEBUG [RS_OPEN_REGION-kiyo:51291-2] zookeeper.ZKAssign(861): regionserver:51291-0x140cc24e86a0002 Transitioned node 1da0a8c300279c072ba5f6fd9c3317d8 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,784 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(376): Transitioned 1da0a8c300279c072ba5f6fd9c3317d8 to OPENED in zk on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,784 DEBUG [RS_OPEN_REGION-kiyo:51291-2] handler.OpenRegionHandler(186): Opened tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,786 DEBUG [AM.ZK.Worker-pool2-t15] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,51291,1377814509998, region=1da0a8c300279c072ba5f6fd9c3317d8, current state from region state map ={1da0a8c300279c072ba5f6fd9c3317d8 state=OPENING, ts=1377814524431, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,786 INFO [AM.ZK.Worker-pool2-t15] master.RegionStates(263): Transitioned from {1da0a8c300279c072ba5f6fd9c3317d8 state=OPENING, ts=1377814524431, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {1da0a8c300279c072ba5f6fd9c3317d8 state=OPEN, ts=1377814524786, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,786 DEBUG [AM.ZK.Worker-pool2-t15] handler.OpenedRegionHandler(150): Handling OPENED event for 1da0a8c300279c072ba5f6fd9c3317d8 from kiyo.gq1.ygridcore.net,51291,1377814509998; deleting unassigned node 2013-08-29 22:15:24,786 DEBUG [AM.ZK.Worker-pool2-t15] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 1da0a8c300279c072ba5f6fd9c3317d8 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,787 INFO [PostOpenDeployTasks:e216da715f0e1cbfad4a22d737c61217] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:15:24,843 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1da0a8c300279c072ba5f6fd9c3317d8 2013-08-29 22:15:24,843 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,844 DEBUG [AM.ZK.Worker-pool2-t15] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 1da0a8c300279c072ba5f6fd9c3317d8 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,844 DEBUG [AM.ZK.Worker-pool2-t15] master.AssignmentManager$4(1276): Znode tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. deleted, state: {1da0a8c300279c072ba5f6fd9c3317d8 state=OPEN, ts=1377814524786, server=kiyo.gq1.ygridcore.net,51291,1377814509998} 2013-08-29 22:15:24,844 INFO [AM.ZK.Worker-pool2-t15] master.RegionStates(299): Onlined 1da0a8c300279c072ba5f6fd9c3317d8 on kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:24,848 INFO [PostOpenDeployTasks:e216da715f0e1cbfad4a22d737c61217] catalog.MetaEditor(462): Updated row tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,848 INFO [PostOpenDeployTasks:e216da715f0e1cbfad4a22d737c61217] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:15:24,848 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning e216da715f0e1cbfad4a22d737c61217 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,855 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:24,858 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,51291,1377814509998, seqNum=0}, attempt=0 of 35 failed; retrying after sleep of 100 because: No server address listed in hbase:meta for region tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. containing row uuu 2013-08-29 22:15:24,871 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e216da715f0e1cbfad4a22d737c61217 2013-08-29 22:15:24,871 DEBUG [RS_OPEN_REGION-kiyo:57016-2] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node e216da715f0e1cbfad4a22d737c61217 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,871 DEBUG [RS_OPEN_REGION-kiyo:57016-2] handler.OpenRegionHandler(376): Transitioned e216da715f0e1cbfad4a22d737c61217 to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,871 DEBUG [RS_OPEN_REGION-kiyo:57016-2] handler.OpenRegionHandler(186): Opened tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,874 DEBUG [AM.ZK.Worker-pool2-t7] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=e216da715f0e1cbfad4a22d737c61217, current state from region state map ={e216da715f0e1cbfad4a22d737c61217 state=OPENING, ts=1377814524500, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,874 INFO [AM.ZK.Worker-pool2-t7] master.RegionStates(263): Transitioned from {e216da715f0e1cbfad4a22d737c61217 state=OPENING, ts=1377814524500, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {e216da715f0e1cbfad4a22d737c61217 state=OPEN, ts=1377814524874, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,874 DEBUG [AM.ZK.Worker-pool2-t7] handler.OpenedRegionHandler(150): Handling OPENED event for e216da715f0e1cbfad4a22d737c61217 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:24,874 DEBUG [AM.ZK.Worker-pool2-t7] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node e216da715f0e1cbfad4a22d737c61217 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,916 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/e216da715f0e1cbfad4a22d737c61217 2013-08-29 22:15:24,916 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:24,917 DEBUG [AM.ZK.Worker-pool2-t7] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node e216da715f0e1cbfad4a22d737c61217 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:24,917 DEBUG [AM.ZK.Worker-pool2-t7] master.AssignmentManager$4(1276): Znode tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. deleted, state: {e216da715f0e1cbfad4a22d737c61217 state=OPEN, ts=1377814524874, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,917 INFO [AM.ZK.Worker-pool2-t7] master.RegionStates(299): Onlined e216da715f0e1cbfad4a22d737c61217 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,957 INFO [StoreOpener-68a7538716d8db76c6342305e700744b-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:24,969 INFO [RS_OPEN_REGION-kiyo:57016-1] regionserver.HRegion(630): Onlined 68a7538716d8db76c6342305e700744b; next sequenceid=1 2013-08-29 22:15:24,969 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 68a7538716d8db76c6342305e700744b 2013-08-29 22:15:24,976 INFO [PostOpenDeployTasks:68a7538716d8db76c6342305e700744b] regionserver.HRegionServer(1691): Post open deploy tasks for region=tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:15:24,983 INFO [PostOpenDeployTasks:68a7538716d8db76c6342305e700744b] catalog.MetaEditor(462): Updated row tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. with server=kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,983 INFO [PostOpenDeployTasks:68a7538716d8db76c6342305e700744b] regionserver.HRegionServer(1716): Finished post open deploy task for tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:15:24,984 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 68a7538716d8db76c6342305e700744b from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,996 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/68a7538716d8db76c6342305e700744b 2013-08-29 22:15:24,996 DEBUG [RS_OPEN_REGION-kiyo:57016-1] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 68a7538716d8db76c6342305e700744b from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:24,996 DEBUG [RS_OPEN_REGION-kiyo:57016-1] handler.OpenRegionHandler(376): Transitioned 68a7538716d8db76c6342305e700744b to OPENED in zk on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,996 DEBUG [RS_OPEN_REGION-kiyo:57016-1] handler.OpenRegionHandler(186): Opened tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:24,997 DEBUG [AM.ZK.Worker-pool2-t16] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=68a7538716d8db76c6342305e700744b, current state from region state map ={68a7538716d8db76c6342305e700744b state=OPENING, ts=1377814524318, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,997 INFO [AM.ZK.Worker-pool2-t16] master.RegionStates(263): Transitioned from {68a7538716d8db76c6342305e700744b state=OPENING, ts=1377814524318, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {68a7538716d8db76c6342305e700744b state=OPEN, ts=1377814524997, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:24,998 DEBUG [AM.ZK.Worker-pool2-t16] handler.OpenedRegionHandler(150): Handling OPENED event for 68a7538716d8db76c6342305e700744b from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:24,998 DEBUG [AM.ZK.Worker-pool2-t16] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001 Deleting existing unassigned node 68a7538716d8db76c6342305e700744b in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:25,012 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/68a7538716d8db76c6342305e700744b 2013-08-29 22:15:25,012 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:25,013 DEBUG [AM.ZK.Worker-pool2-t16] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001 Deleted unassigned node 68a7538716d8db76c6342305e700744b in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:25,013 DEBUG [AM.ZK.Worker-pool2-t16] master.AssignmentManager$4(1276): Znode tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. deleted, state: {68a7538716d8db76c6342305e700744b state=OPEN, ts=1377814524997, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:25,013 INFO [AM.ZK.Worker-pool2-t16] master.RegionStates(299): Onlined 68a7538716d8db76c6342305e700744b on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:25,026 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:25,952 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => a9f08b5289c0817bc15b68dd39ca295a, NAME => 'tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a.', STARTKEY => '', ENDKEY => 'bbb'} 2013-08-29 22:15:25,952 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'bbb' 2013-08-29 22:15:25,994 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => e16cb91aec0ea3dd068fbaf236ee81fa, NAME => 'tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2013-08-29 22:15:25,994 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'ccc' 2013-08-29 22:15:26,031 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 850bc9f74b9620f114115790531a78ae, NAME => 'tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2013-08-29 22:15:26,031 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'ddd' 2013-08-29 22:15:26,069 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 013bc94b13efec611d74c9d002c0f201, NAME => 'tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2013-08-29 22:15:26,070 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'eee' 2013-08-29 22:15:26,106 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 411506c2261eadd186d247f40f8b53d0, NAME => 'tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0.', STARTKEY => 'eee', ENDKEY => 'fff'} 2013-08-29 22:15:26,107 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'fff' 2013-08-29 22:15:26,142 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 9726b1bb649d384a3531183536e758f2, NAME => 'tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2013-08-29 22:15:26,142 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'ggg' 2013-08-29 22:15:26,179 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 11a9c621d13d5b11ed27a0104fdd0798, NAME => 'tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2013-08-29 22:15:26,179 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'hhh' 2013-08-29 22:15:26,232 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 632b714a3ec4d729e14be6daae99619a, NAME => 'tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2013-08-29 22:15:26,232 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'iii' 2013-08-29 22:15:26,290 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 8312930da68dfb12296f5cbb3a37f843, NAME => 'tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2013-08-29 22:15:26,291 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'jjj' 2013-08-29 22:15:26,354 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 768e8db1c5d6cfe64da81f9daecf0999, NAME => 'tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2013-08-29 22:15:26,354 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'kkk' 2013-08-29 22:15:26,411 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => e27461887c1893e0726079fcddd51b6a, NAME => 'tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2013-08-29 22:15:26,411 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'lll' 2013-08-29 22:15:26,476 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 5083515e811013bc2a8be90523d4a81a, NAME => 'tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2013-08-29 22:15:26,476 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'mmm' 2013-08-29 22:15:26,527 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 725a1977cc9ede4514e8029d5522b6ee, NAME => 'tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2013-08-29 22:15:26,527 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'nnn' 2013-08-29 22:15:26,582 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 60dd6b689221b85fed89c65d2cfd13b2, NAME => 'tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2013-08-29 22:15:26,582 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'ooo' 2013-08-29 22:15:26,631 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 16d9fd46b6932e1be21e5e7f4dd79ac4, NAME => 'tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2013-08-29 22:15:26,631 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'ppp' 2013-08-29 22:15:26,680 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => e0f77722c886c7dbde9efcde4f60c2c6, NAME => 'tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2013-08-29 22:15:26,681 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'qqq' 2013-08-29 22:15:26,732 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 63449e4bed174f301e94011ae27a579b, NAME => 'tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2013-08-29 22:15:26,732 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'rrr' 2013-08-29 22:15:26,784 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 80313bc36e51c8a392f5a074bc08d6e9, NAME => 'tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2013-08-29 22:15:26,784 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'sss' 2013-08-29 22:15:26,842 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 407a01405eb76853035e2d90869eecf0, NAME => 'tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2013-08-29 22:15:26,842 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'ttt' 2013-08-29 22:15:26,893 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 12d9a59d636d44af012cc60809b2e9ad, NAME => 'tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2013-08-29 22:15:26,893 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'uuu' 2013-08-29 22:15:26,950 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 68a7538716d8db76c6342305e700744b, NAME => 'tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2013-08-29 22:15:26,951 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'vvv' 2013-08-29 22:15:26,999 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => e7bde0f77848062af569d79f61a83b4c, NAME => 'tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c.', STARTKEY => 'vvv', ENDKEY => 'www'} 2013-08-29 22:15:26,999 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'www' 2013-08-29 22:15:27,046 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => e216da715f0e1cbfad4a22d737c61217, NAME => 'tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217.', STARTKEY => 'www', ENDKEY => 'xxx'} 2013-08-29 22:15:27,046 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'xxx' 2013-08-29 22:15:27,080 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => 1bebce232a6486e349b4548a81ce3c34, NAME => 'tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2013-08-29 22:15:27,080 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'yyy' 2013-08-29 22:15:27,106 DEBUG [Thread-221] client.ClientScanner(218): Finished {ENCODED => 1da0a8c300279c072ba5f6fd9c3317d8, NAME => 'tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8.', STARTKEY => 'yyy', ENDKEY => ''} 2013-08-29 22:15:27,803 INFO [Thread-221-EventThread] hbase.HBaseTestingUtility$1(2212): Monitor ZKW received event=WatchedEvent state:SyncConnected type:None path:null 2013-08-29 22:15:27,903 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:51291-0x140cc24e86a0002 Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:15:27,903 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(394): regionserver:51291-0x140cc24e86a0002 Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:15:27,903 INFO [Thread-221-EventThread] hbase.HBaseTestingUtility$1(2212): Monitor ZKW received event=WatchedEvent state:Disconnected type:None path:null 2013-08-29 22:15:27,983 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:27,984 INFO [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(94): RegionServer ephemeral node deleted, processing expiration [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:15:27,984 INFO [Thread-221] hbase.HBaseTestingUtility(2228): ZK Closed Session 0x140cc24e86a0002 2013-08-29 22:15:27,986 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,51291,1377814509998 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:27,989 DEBUG [pool-1-thread-1-EventThread] master.ServerManager(510): Added=kiyo.gq1.ygridcore.net,51291,1377814509998 to dead servers, submitted shutdown handler to be executed meta=true 2013-08-29 22:15:27,989 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] handler.MetaServerShutdownHandler(59): Splitting META logs for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:27,989 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2013-08-29 22:15:27,990 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] zookeeper.ZKUtil(690): master:44745-0x140cc24e86a0001 Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2013-08-29 22:15:27,991 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:44745-0x140cc24e86a0001 Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:28,218 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(1159): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:28,219 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,51291,1377814509998 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:28,220 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] handler.MetaServerShutdownHandler(78): Server kiyo.gq1.ygridcore.net,51291,1377814509998 was carrying META. Trying to assign. 2013-08-29 22:15:28,220 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.RegionStates(340): Offline 1588230740 with current state=OPEN, expected state=OFFLINE/SPLITTING/MERGING 2013-08-29 22:15:28,220 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.RegionStates(263): Transitioned from {1588230740 state=OPEN, ts=1377814515509, server=kiyo.gq1.ygridcore.net,51291,1377814509998} to {1588230740 state=OFFLINE, ts=1377814528220, server=null} 2013-08-29 22:15:28,220 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.RegionStates(356): Offlined 1588230740 from kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:28,412 DEBUG [RpcServer.handler=4,port=44745] master.ServerManager(336): Server REPORT rejected; currently processing kiyo.gq1.ygridcore.net,51291,1377814509998 as dead server 2013-08-29 22:15:28,417 FATAL [RS:0;kiyo:51291] regionserver.HRegionServer(1739): ABORTING region server kiyo.gq1.ygridcore.net,51291,1377814509998: org.apache.hadoop.hbase.YouAreDeadException: Server REPORT rejected; currently processing kiyo.gq1.ygridcore.net,51291,1377814509998 as dead server at org.apache.hadoop.hbase.master.ServerManager.checkIsDead(ServerManager.java:337) at org.apache.hadoop.hbase.master.ServerManager.regionServerReport(ServerManager.java:252) at org.apache.hadoop.hbase.master.HMaster.regionServerReport(HMaster.java:1421) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:5087) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) org.apache.hadoop.hbase.YouAreDeadException: org.apache.hadoop.hbase.YouAreDeadException: Server REPORT rejected; currently processing kiyo.gq1.ygridcore.net,51291,1377814509998 as dead server at org.apache.hadoop.hbase.master.ServerManager.checkIsDead(ServerManager.java:337) at org.apache.hadoop.hbase.master.ServerManager.regionServerReport(ServerManager.java:252) at org.apache.hadoop.hbase.master.HMaster.regionServerReport(HMaster.java:1421) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:5087) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:235) at org.apache.hadoop.hbase.regionserver.HRegionServer.tryRegionServerReport(HRegionServer.java:1000) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:849) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:157) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:109) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:141) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:337) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1457) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.hbase.util.Methods.call(Methods.java:41) at org.apache.hadoop.hbase.security.User.call(User.java:420) at org.apache.hadoop.hbase.security.User.access$300(User.java:51) at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:260) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:139) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.YouAreDeadException): org.apache.hadoop.hbase.YouAreDeadException: Server REPORT rejected; currently processing kiyo.gq1.ygridcore.net,51291,1377814509998 as dead server at org.apache.hadoop.hbase.master.ServerManager.checkIsDead(ServerManager.java:337) at org.apache.hadoop.hbase.master.ServerManager.regionServerReport(ServerManager.java:252) at org.apache.hadoop.hbase.master.HMaster.regionServerReport(HMaster.java:1421) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:5087) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1425) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1629) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1686) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$BlockingStub.regionServerReport(RegionServerStatusProtos.java:5414) at org.apache.hadoop.hbase.regionserver.HRegionServer.tryRegionServerReport(HRegionServer.java:998) ... 17 more 2013-08-29 22:15:28,419 FATAL [RS:0;kiyo:51291] regionserver.HRegionServer(1747): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2013-08-29 22:15:28,424 ERROR [RpcServer.handler=0,port=44745] master.HMaster(1440): Region server kiyo.gq1.ygridcore.net,51291,1377814509998 reported a fatal error: ABORTING region server kiyo.gq1.ygridcore.net,51291,1377814509998: org.apache.hadoop.hbase.YouAreDeadException: Server REPORT rejected; currently processing kiyo.gq1.ygridcore.net,51291,1377814509998 as dead server at org.apache.hadoop.hbase.master.ServerManager.checkIsDead(ServerManager.java:337) at org.apache.hadoop.hbase.master.ServerManager.regionServerReport(ServerManager.java:252) at org.apache.hadoop.hbase.master.HMaster.regionServerReport(HMaster.java:1421) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:5087) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) Cause: org.apache.hadoop.hbase.YouAreDeadException: org.apache.hadoop.hbase.YouAreDeadException: Server REPORT rejected; currently processing kiyo.gq1.ygridcore.net,51291,1377814509998 as dead server at org.apache.hadoop.hbase.master.ServerManager.checkIsDead(ServerManager.java:337) at org.apache.hadoop.hbase.master.ServerManager.regionServerReport(ServerManager.java:252) at org.apache.hadoop.hbase.master.HMaster.regionServerReport(HMaster.java:1421) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:5087) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:235) at org.apache.hadoop.hbase.regionserver.HRegionServer.tryRegionServerReport(HRegionServer.java:1000) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:849) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:157) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:109) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:141) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:337) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1457) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.hbase.util.Methods.call(Methods.java:41) at org.apache.hadoop.hbase.security.User.call(User.java:420) at org.apache.hadoop.hbase.security.User.access$300(User.java:51) at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:260) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:139) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.YouAreDeadException): org.apache.hadoop.hbase.YouAreDeadException: Server REPORT rejected; currently processing kiyo.gq1.ygridcore.net,51291,1377814509998 as dead server at org.apache.hadoop.hbase.master.ServerManager.checkIsDead(ServerManager.java:337) at org.apache.hadoop.hbase.master.ServerManager.regionServerReport(ServerManager.java:252) at org.apache.hadoop.hbase.master.HMaster.regionServerReport(HMaster.java:1421) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:5087) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1425) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1629) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1686) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$BlockingStub.regionServerReport(RegionServerStatusProtos.java:5414) at org.apache.hadoop.hbase.regionserver.HRegionServer.tryRegionServerReport(HRegionServer.java:998) ... 17 more 2013-08-29 22:15:28,426 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(1673): STOPPED: org.apache.hadoop.hbase.YouAreDeadException: Server REPORT rejected; currently processing kiyo.gq1.ygridcore.net,51291,1377814509998 as dead server at org.apache.hadoop.hbase.master.ServerManager.checkIsDead(ServerManager.java:337) at org.apache.hadoop.hbase.master.ServerManager.regionServerReport(ServerManager.java:252) at org.apache.hadoop.hbase.master.HMaster.regionServerReport(HMaster.java:1421) at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:5087) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:15:28,428 INFO [RS:0;kiyo:51291] regionserver.SplitLogWorker(603): Sending interrupt to stop the worker thread 2013-08-29 22:15:28,428 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998] regionserver.SplitLogWorker(288): SplitLogWorker interrupted while waiting for task, exiting: java.lang.InterruptedException 2013-08-29 22:15:28,429 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998] regionserver.SplitLogWorker(212): SplitLogWorker kiyo.gq1.ygridcore.net,51291,1377814509998 exiting 2013-08-29 22:15:28,430 INFO [RS:0;kiyo:51291] snapshot.RegionServerSnapshotManager(152): Stopping RegionServerSnapshotManager abruptly. 2013-08-29 22:15:28,430 INFO [Thread-165] regionserver.MemStoreFlusher$FlushHandler(269): Thread-165 exiting 2013-08-29 22:15:28,430 INFO [RS:0;kiyo:51291.logRoller] regionserver.LogRoller(119): LogRoller exiting. 2013-08-29 22:15:28,430 INFO [RS_OPEN_META-kiyo:51291-0-MetaLogRoller] regionserver.LogRoller(119): LogRoller exiting. 2013-08-29 22:15:28,430 INFO [RS:0;kiyo:51291.compactionChecker] hbase.Chore(93): RS:0;kiyo:51291.compactionChecker exiting 2013-08-29 22:15:28,432 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(125): Processing close of tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:28,432 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(125): Processing close of tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:28,432 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] handler.CloseRegionHandler(125): Processing close of tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:28,432 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(950): Closing tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee.: disabling compactions & flushes 2013-08-29 22:15:28,433 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(911): aborting server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:28,433 DEBUG [RS:0;kiyo:51291] catalog.CatalogTracker(208): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@75144026 2013-08-29 22:15:28,433 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(972): Updates disabled for region tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:28,434 INFO [RS:0;kiyo:51291] client.HConnectionManager$HConnectionImplementation(1926): Closing zookeeper sessionid=0x140cc24e86a0006 2013-08-29 22:15:28,433 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(950): Closing tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a.: disabling compactions & flushes 2013-08-29 22:15:28,434 INFO [StoreCloserThread-tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,433 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(950): Closing tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad.: disabling compactions & flushes 2013-08-29 22:15:28,434 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(972): Updates disabled for region tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:28,434 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(972): Updates disabled for region tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:28,435 INFO [StoreCloserThread-tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,435 INFO [StoreCloserThread-tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,436 INFO [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(1030): Closed tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:28,436 INFO [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(1030): Closed tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:28,436 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(176): Closed tabletest,mmm,1377814517511.725a1977cc9ede4514e8029d5522b6ee. 2013-08-29 22:15:28,437 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(125): Processing close of tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:28,436 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(176): Closed tabletest,ttt,1377814517548.12d9a59d636d44af012cc60809b2e9ad. 2013-08-29 22:15:28,437 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(950): Closing tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0.: disabling compactions & flushes 2013-08-29 22:15:28,437 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(972): Updates disabled for region tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:28,436 INFO [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(1030): Closed tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:28,437 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(125): Processing close of tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:28,438 INFO [StoreCloserThread-tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,438 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(950): Closing tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c.: disabling compactions & flushes 2013-08-29 22:15:28,438 INFO [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(1030): Closed tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:28,438 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(176): Closed tabletest,eee,1377814517474.411506c2261eadd186d247f40f8b53d0. 2013-08-29 22:15:28,439 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(125): Processing close of tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:28,438 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] handler.CloseRegionHandler(176): Closed tabletest,kkk,1377814517501.e27461887c1893e0726079fcddd51b6a. 2013-08-29 22:15:28,439 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(950): Closing tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a.: disabling compactions & flushes 2013-08-29 22:15:28,439 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] handler.CloseRegionHandler(125): Processing close of tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:28,438 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(972): Updates disabled for region tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:28,439 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(972): Updates disabled for region tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:28,440 INFO [StoreCloserThread-tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,440 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(950): Closing tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999.: disabling compactions & flushes 2013-08-29 22:15:28,440 INFO [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(1030): Closed tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:28,440 INFO [StoreCloserThread-tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,440 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(972): Updates disabled for region tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:28,441 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(176): Closed tabletest,vvv,1377814517557.e7bde0f77848062af569d79f61a83b4c. 2013-08-29 22:15:28,441 INFO [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(1030): Closed tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:28,441 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(125): Processing close of tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:28,441 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(176): Closed tabletest,lll,1377814517506.5083515e811013bc2a8be90523d4a81a. 2013-08-29 22:15:28,441 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(950): Closing tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a.: disabling compactions & flushes 2013-08-29 22:15:28,442 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(125): Processing close of tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:28,442 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(972): Updates disabled for region tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:28,442 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(950): Closing tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae.: disabling compactions & flushes 2013-08-29 22:15:28,441 INFO [StoreCloserThread-tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,442 INFO [StoreCloserThread-tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,442 INFO [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(1030): Closed tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:28,442 INFO [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(1030): Closed tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:28,442 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(972): Updates disabled for region tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:28,443 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(176): Closed tabletest,hhh,1377814517487.632b714a3ec4d729e14be6daae99619a. 2013-08-29 22:15:28,442 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] handler.CloseRegionHandler(176): Closed tabletest,jjj,1377814517496.768e8db1c5d6cfe64da81f9daecf0999. 2013-08-29 22:15:28,443 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(125): Processing close of hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:28,443 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] handler.CloseRegionHandler(125): Processing close of tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:28,443 INFO [StoreCloserThread-tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,443 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(950): Closing tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8.: disabling compactions & flushes 2013-08-29 22:15:28,444 INFO [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(1030): Closed tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:28,444 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(176): Closed tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. 2013-08-29 22:15:28,443 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(950): Closing hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa.: disabling compactions & flushes 2013-08-29 22:15:28,444 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(125): Processing close of tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:28,444 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(972): Updates disabled for region hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:28,445 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(950): Closing tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34.: disabling compactions & flushes 2013-08-29 22:15:28,444 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(972): Updates disabled for region tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:28,445 INFO [StoreCloserThread-hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa.-1] regionserver.HStore(668): Closed info 2013-08-29 22:15:28,445 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(972): Updates disabled for region tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:28,445 INFO [StoreCloserThread-tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,445 INFO [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(1030): Closed hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:28,445 INFO [StoreCloserThread-tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,446 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(176): Closed hbase:namespace,,1377814515634.d9bcf0514fd39a6c145441a17596cffa. 2013-08-29 22:15:28,445 INFO [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(1030): Closed tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:28,446 INFO [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(1030): Closed tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:28,446 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] handler.CloseRegionHandler(176): Closed tabletest,yyy,1377814517570.1da0a8c300279c072ba5f6fd9c3317d8. 2013-08-29 22:15:28,446 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(125): Processing close of tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:28,446 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] handler.CloseRegionHandler(125): Processing close of tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:28,446 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(176): Closed tabletest,xxx,1377814517566.1bebce232a6486e349b4548a81ce3c34. 2013-08-29 22:15:28,447 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(950): Closing tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201.: disabling compactions & flushes 2013-08-29 22:15:28,447 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(125): Processing close of tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:28,447 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(950): Closing tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639.: disabling compactions & flushes 2013-08-29 22:15:28,448 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(950): Closing tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843.: disabling compactions & flushes 2013-08-29 22:15:28,448 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(972): Updates disabled for region tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:28,447 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(972): Updates disabled for region tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:28,448 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(972): Updates disabled for region tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:28,448 INFO [StoreCloserThread-tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,448 INFO [StoreCloserThread-tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,449 INFO [StoreCloserThread-tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843.-1] regionserver.HStore(668): Closed family 2013-08-29 22:15:28,449 INFO [RS_CLOSE_REGION-kiyo:51291-2] regionserver.HRegion(1030): Closed tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:28,449 INFO [RS_CLOSE_REGION-kiyo:51291-1] regionserver.HRegion(1030): Closed tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:28,449 INFO [RS_CLOSE_REGION-kiyo:51291-0] regionserver.HRegion(1030): Closed tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:28,449 DEBUG [RS_CLOSE_REGION-kiyo:51291-2] handler.CloseRegionHandler(176): Closed tabletest,ddd,1377814517469.013bc94b13efec611d74c9d002c0f201. 2013-08-29 22:15:28,449 DEBUG [RS_CLOSE_REGION-kiyo:51291-1] handler.CloseRegionHandler(176): Closed tabletest,,1377814516999.aec47101ea5cc382f708256b11a18639. 2013-08-29 22:15:28,450 DEBUG [RS_CLOSE_REGION-kiyo:51291-0] handler.CloseRegionHandler(176): Closed tabletest,iii,1377814517492.8312930da68dfb12296f5cbb3a37f843. 2013-08-29 22:15:28,616 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => a9f08b5289c0817bc15b68dd39ca295a, NAME => 'tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a.', STARTKEY => '', ENDKEY => 'bbb'} 2013-08-29 22:15:28,617 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'bbb' 2013-08-29 22:15:28,645 DEBUG [Thread-221] client.ClientScanner(224): Finished {ENCODED => e16cb91aec0ea3dd068fbaf236ee81fa, NAME => 'tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2013-08-29 22:15:28,645 DEBUG [Thread-221] client.ClientScanner(232): Advancing internal scanner to startKey at 'ccc' 2013-08-29 22:15:28,650 INFO [RS:0;kiyo:51291] regionserver.CompactSplitThread(357): Waiting for Split Thread to finish... 2013-08-29 22:15:28,650 INFO [RS:0;kiyo:51291] regionserver.CompactSplitThread(357): Waiting for Merge Thread to finish... 2013-08-29 22:15:28,651 INFO [RS:0;kiyo:51291] regionserver.CompactSplitThread(357): Waiting for Large Compaction Thread to finish... 2013-08-29 22:15:28,651 INFO [RS:0;kiyo:51291] regionserver.CompactSplitThread(357): Waiting for Small Compaction Thread to finish... 2013-08-29 22:15:28,651 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(1075): Waiting on 1 regions to close 2013-08-29 22:15:28,651 DEBUG [RS_CLOSE_META-kiyo:51291-0] handler.CloseRegionHandler(125): Processing close of hbase:meta,,1.1588230740 2013-08-29 22:15:28,652 DEBUG [RS:0;kiyo:51291] regionserver.HRegionServer(1079): {1588230740=hbase:meta,,1.1588230740} 2013-08-29 22:15:28,652 DEBUG [RS_CLOSE_META-kiyo:51291-0] regionserver.HRegion(950): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2013-08-29 22:15:28,653 DEBUG [RS_CLOSE_META-kiyo:51291-0] regionserver.HRegion(972): Updates disabled for region hbase:meta,,1.1588230740 2013-08-29 22:15:28,653 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(668): Closed info 2013-08-29 22:15:28,654 INFO [RS_CLOSE_META-kiyo:51291-0] regionserver.HRegion(1030): Closed hbase:meta,,1.1588230740 2013-08-29 22:15:28,654 DEBUG [RS_CLOSE_META-kiyo:51291-0] handler.CloseRegionHandler(176): Closed hbase:meta,,1.1588230740 2013-08-29 22:15:28,853 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(934): stopping server kiyo.gq1.ygridcore.net,51291,1377814509998; all regions closed. 2013-08-29 22:15:28,853 INFO [RS_OPEN_META-kiyo:51291-0.logSyncer] wal.FSHLog$LogSyncer(976): RS_OPEN_META-kiyo:51291-0.logSyncer exiting 2013-08-29 22:15:28,853 DEBUG [RS:0;kiyo:51291] wal.FSHLog(811): Closing WAL writer in hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:28,857 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:15:28,858 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741832_1008 size 15387 2013-08-29 22:15:28,951 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1362): Removed kiyo.gq1.ygridcore.net:51291 as a location of tabletest,ccc,1377814517465.850bc9f74b9620f114115790531a78ae. for tableName=tabletest from cache 2013-08-29 22:15:28,952 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,51291,1377814509998, seqNum=0}, attempt=0 of 35 failed; retrying after sleep of 100 because: Connection refused 2013-08-29 22:15:29,056 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,51291,1377814509998, seqNum=0}, attempt=1 of 35 failed; retrying after sleep of 201 because: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:51291 2013-08-29 22:15:29,057 INFO [RS:0;kiyo:51291.logSyncer] wal.FSHLog$LogSyncer(976): RS:0;kiyo:51291.logSyncer exiting 2013-08-29 22:15:29,057 DEBUG [RS:0;kiyo:51291] wal.FSHLog(811): Closing WAL writer in hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:29,060 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:15:29,061 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741833_1009 size 1649487 2013-08-29 22:15:29,202 INFO [RS:0;kiyo:51291] regionserver.Leases(147): RS:0;kiyo:51291 closing leases 2013-08-29 22:15:29,202 INFO [RS:0;kiyo:51291] regionserver.Leases(150): RS:0;kiyo:51291 closed leases 2013-08-29 22:15:29,234 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] catalog.CatalogTracker(406): Failed verification of hbase:meta,,1 at address=kiyo.gq1.ygridcore.net,51291,1377814509998, exception=java.io.EOFException 2013-08-29 22:15:29,235 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] zookeeper.MetaRegionTracker(164): Unsetting META region location in ZooKeeper 2013-08-29 22:15:29,316 INFO [RS:0;kiyo:51291.periodicFlusher] hbase.Chore(93): RS:0;kiyo:51291.periodicFlusher exiting 2013-08-29 22:15:29,317 INFO [RS:0;kiyo:51291.leaseChecker] regionserver.Leases(147): RS:0;kiyo:51291.leaseChecker closing leases 2013-08-29 22:15:29,318 INFO [RS:0;kiyo:51291.leaseChecker] regionserver.Leases(150): RS:0;kiyo:51291.leaseChecker closed leases 2013-08-29 22:15:29,369 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/meta-region-server 2013-08-29 22:15:29,369 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/meta-region-server 2013-08-29 22:15:29,370 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.AssignmentManager(2196): No previous transition plan was found (or we are ignoring an existing plan) for hbase:meta,,1.1588230740 so generated a random one; hri=hbase:meta,,1.1588230740, src=, dest=kiyo.gq1.ygridcore.net,57016,1377814510039; 1 (online=1, available=1) available servers, forceNewPlan=false 2013-08-29 22:15:29,370 DEBUG [Thread-221] zookeeper.ZKUtil(690): hconnection-0x72213339-0x140cc24e86a000a Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2013-08-29 22:15:29,370 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] zookeeper.ZKAssign(208): master:44745-0x140cc24e86a0001 Creating (or updating) unassigned node 1588230740 with OFFLINE state 2013-08-29 22:15:29,371 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(433): master:44745-0x140cc24e86a0001 Set watcher on znode that does not yet exist, /hbase/meta-region-server 2013-08-29 22:15:29,371 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZKUtil(433): regionserver:57016-0x140cc24e86a0003 Set watcher on znode that does not yet exist, /hbase/meta-region-server 2013-08-29 22:15:29,508 DEBUG [RS:0;kiyo:51291-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:51291-0x140cc24e86a0002 Received ZooKeeper Event, type=None, state=Expired, path=null 2013-08-29 22:15:29,509 FATAL [RS:0;kiyo:51291-EventThread] regionserver.HRegionServer(1739): ABORTING region server kiyo.gq1.ygridcore.net,51291,1377814509998: regionserver:51291-0x140cc24e86a0002 regionserver:51291-0x140cc24e86a0002 received expired from ZooKeeper, aborting org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:403) at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:321) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) 2013-08-29 22:15:29,509 FATAL [RS:0;kiyo:51291-EventThread] regionserver.HRegionServer(1747): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2013-08-29 22:15:29,509 INFO [RS:0;kiyo:51291-EventThread] regionserver.HRegionServer(1673): STOPPED: regionserver:51291-0x140cc24e86a0002 regionserver:51291-0x140cc24e86a0002 received expired from ZooKeeper, aborting 2013-08-29 22:15:29,540 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:29,542 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.AssignmentManager(1917): Assigning hbase:meta,,1.1588230740 to kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:29,542 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.RegionStates(263): Transitioned from {1588230740 state=OFFLINE, ts=1377814529370, server=null} to {1588230740 state=PENDING_OPEN, ts=1377814529542, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:29,543 INFO [RpcServer.handler=0,port=57016] regionserver.HRegionServer(3521): Open hbase:meta,,1.1588230740 2013-08-29 22:15:29,545 DEBUG [RS_OPEN_META-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:29,545 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.AssignmentManager(2873): Waiting on null to clear regions-in-transition 2013-08-29 22:15:29,576 DEBUG [Thread-221] zookeeper.ZKUtil(690): hconnection-0x72213339-0x140cc24e86a000a Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2013-08-29 22:15:29,576 DEBUG [RS_OPEN_META-kiyo:57016-0] zookeeper.ZKAssign(861): regionserver:57016-0x140cc24e86a0003 Transitioned node 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2013-08-29 22:15:29,576 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2013-08-29 22:15:29,576 DEBUG [RS_OPEN_META-kiyo:57016-0] regionserver.HRegionServer(1439): logdir=hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:29,577 INFO [RS_OPEN_META-kiyo:57016-0] wal.FSHLog(353): WAL/HLog configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, optionallogflushinternal=1000ms 2013-08-29 22:15:29,578 DEBUG [AM.ZK.Worker-pool2-t9] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=1588230740, current state from region state map ={1588230740 state=PENDING_OPEN, ts=1377814529542, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:29,578 INFO [AM.ZK.Worker-pool2-t9] master.RegionStates(263): Transitioned from {1588230740 state=PENDING_OPEN, ts=1377814529542, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {1588230740 state=OPENING, ts=1377814529578, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:29,608 WARN [RS:0;kiyo:51291] zookeeper.RecoverableZooKeeper(258): Possibly transient ZooKeeper, quorum=localhost:61251, exception=org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:29,609 INFO [RS:0;kiyo:51291] util.RetryCounter(54): Sleeping 2000ms before retry #1... 2013-08-29 22:15:29,685 INFO [RS_OPEN_META-kiyo:57016-0] wal.FSHLog(525): New WAL /user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,57016,1377814510039/kiyo.gq1.ygridcore.net%2C57016%2C1377814510039.1377814529580.meta 2013-08-29 22:15:29,685 DEBUG [RS_OPEN_META-kiyo:57016-0] regionserver.HRegion(4085): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2013-08-29 22:15:29,691 DEBUG [RS_OPEN_META-kiyo:57016-0] coprocessor.CoprocessorHost(181): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2013-08-29 22:15:29,692 DEBUG [RS_OPEN_META-kiyo:57016-0] regionserver.HRegion(5059): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2013-08-29 22:15:29,693 INFO [RS_OPEN_META-kiyo:57016-0] regionserver.RegionCoprocessorHost(196): Load coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2013-08-29 22:15:29,694 DEBUG [RS_OPEN_META-kiyo:57016-0] regionserver.MetricsRegionSourceImpl(62): Creating new MetricsRegionSourceImpl for table hbase:meta 1588230740 2013-08-29 22:15:29,695 DEBUG [RS_OPEN_META-kiyo:57016-0] regionserver.HRegion(535): Instantiated hbase:meta,,1.1588230740 2013-08-29 22:15:29,701 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(85): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2013-08-29 22:15:29,706 INFO [RS_OPEN_META-kiyo:57016-0] regionserver.HRegion(630): Onlined 1588230740; next sequenceid=1 2013-08-29 22:15:29,706 DEBUG [RS_OPEN_META-kiyo:57016-0] zookeeper.ZKAssign(598): regionserver:57016-0x140cc24e86a0003 Attempting to retransition opening state of node 1588230740 2013-08-29 22:15:29,708 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1691): Post open deploy tasks for region=hbase:meta,,1.1588230740 2013-08-29 22:15:29,817 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/recovering-regions/1588230740 2013-08-29 22:15:29,817 DEBUG [Thread-221] zookeeper.ZKUtil(690): hconnection-0x72213339-0x140cc24e86a000a Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2013-08-29 22:15:29,949 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(4322): Update last flushed sequence id of region 1588230740 for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:29,949 INFO [PostOpenDeployTasks:1588230740] zookeeper.MetaRegionTracker(123): Setting META region location in ZooKeeper as kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:29,975 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2013-08-29 22:15:29,975 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2013-08-29 22:15:29,977 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1716): Finished post open deploy task for hbase:meta,,1.1588230740 2013-08-29 22:15:29,978 DEBUG [RS_OPEN_META-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003 Transitioning 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2013-08-29 22:15:31,609 WARN [RS:0;kiyo:51291] zookeeper.RecoverableZooKeeper(258): Possibly transient ZooKeeper, quorum=localhost:61251, exception=org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:31,609 INFO [RS:0;kiyo:51291] util.RetryCounter(54): Sleeping 4000ms before retry #2... 2013-08-29 22:15:31,747 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x6f54c08a-0x140cc24e86a0005 Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:15:31,747 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(394): hconnection-0x6f54c08a-0x140cc24e86a0005 Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:15:31,824 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x2a36bb87-0x140cc24e86a0007 Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:15:31,824 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039-EventThread] zookeeper.ZooKeeperWatcher(394): hconnection-0x2a36bb87-0x140cc24e86a0007 Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:15:31,842 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x50ba0dfc-0x140cc24e86a0008 Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:15:31,842 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998-EventThread] zookeeper.ZooKeeperWatcher(394): hconnection-0x50ba0dfc-0x140cc24e86a0008 Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:15:32,351 DEBUG [M:0;kiyo:44745-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x173f7175-0x140cc24e86a0004 Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:15:32,351 DEBUG [M:0;kiyo:44745-EventThread] zookeeper.ZooKeeperWatcher(394): hconnection-0x173f7175-0x140cc24e86a0004 Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:15:32,584 WARN [Thread-221] zookeeper.RecoverableZooKeeper(258): Possibly transient ZooKeeper, quorum=localhost:61251, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/meta-region-server 2013-08-29 22:15:32,584 INFO [Thread-221] util.RetryCounter(54): Sleeping 2000ms before retry #1... 2013-08-29 22:15:32,584 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x72213339-0x140cc24e86a000a Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:15:32,584 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(394): hconnection-0x72213339-0x140cc24e86a000a Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:15:32,743 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:15:32,743 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(394): master:44745-0x140cc24e86a0001 Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:15:32,746 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003 Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:15:32,746 WARN [RS_OPEN_META-kiyo:57016-0] zookeeper.RecoverableZooKeeper(258): Possibly transient ZooKeeper, quorum=localhost:61251, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/region-in-transition/1588230740 2013-08-29 22:15:32,746 INFO [RS_OPEN_META-kiyo:57016-0] util.RetryCounter(54): Sleeping 2000ms before retry #1... 2013-08-29 22:15:32,746 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(394): regionserver:57016-0x140cc24e86a0003 Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:15:33,156 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x50ba0dfc-0x140cc24e86a0008 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:33,157 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,51291,1377814509998-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x50ba0dfc-0x140cc24e86a0008-0x140cc24e86a0008 connected 2013-08-29 22:15:33,312 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x6f54c08a-0x140cc24e86a0005 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:33,314 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x6f54c08a-0x140cc24e86a0005-0x140cc24e86a0005 connected 2013-08-29 22:15:33,542 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404) at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:167) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:101) 2013-08-29 22:15:33,543 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:138) 2013-08-29 22:15:33,543 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:138) 2013-08-29 22:15:33,543 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:138) 2013-08-29 22:15:33,543 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:138) 2013-08-29 22:15:33,544 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:138) 2013-08-29 22:15:33,544 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:138) 2013-08-29 22:15:33,544 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:138) 2013-08-29 22:15:33,544 ERROR [SyncThread:0] server.NIOServerCnxn(180): Unexpected Exception: java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153) at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170) at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:138) 2013-08-29 22:15:33,718 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x72213339-0x140cc24e86a000a Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:33,720 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x72213339-0x140cc24e86a000a-0x140cc24e86a000a connected 2013-08-29 22:15:33,818 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x2a36bb87-0x140cc24e86a0007 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:33,819 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x2a36bb87-0x140cc24e86a0007-0x140cc24e86a0007 connected 2013-08-29 22:15:33,867 DEBUG [M:0;kiyo:44745-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x173f7175-0x140cc24e86a0004 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:33,868 DEBUG [M:0;kiyo:44745-EventThread] zookeeper.ZooKeeperWatcher(389): hconnection-0x173f7175-0x140cc24e86a0004-0x140cc24e86a0004 connected 2013-08-29 22:15:34,145 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:34,147 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(389): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 connected 2013-08-29 22:15:34,147 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2013-08-29 22:15:34,148 DEBUG [AM.ZK.Worker-pool2-t4] master.AssignmentManager(801): Handling transition=RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,57016,1377814510039, region=1588230740, current state from region state map ={1588230740 state=OPENING, ts=1377814529578, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:34,148 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates(263): Transitioned from {1588230740 state=OPENING, ts=1377814529578, server=kiyo.gq1.ygridcore.net,57016,1377814510039} to {1588230740 state=OPEN, ts=1377814534148, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:34,148 INFO [AM.ZK.Worker-pool2-t4] handler.OpenedRegionHandler(148): Handling OPENED event for 1588230740 from kiyo.gq1.ygridcore.net,57016,1377814510039; deleting unassigned node 2013-08-29 22:15:34,149 DEBUG [AM.ZK.Worker-pool2-t4] zookeeper.ZKAssign(405): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Deleting existing unassigned node 1588230740 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:34,179 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2013-08-29 22:15:34,179 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2013-08-29 22:15:34,180 DEBUG [AM.ZK.Worker-pool2-t4] zookeeper.ZKAssign(434): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Deleted unassigned node 1588230740 in expected state RS_ZK_REGION_OPENED 2013-08-29 22:15:34,180 DEBUG [AM.ZK.Worker-pool2-t4] master.AssignmentManager$4(1276): Znode hbase:meta,,1.1588230740 deleted, state: {1588230740 state=OPEN, ts=1377814534148, server=kiyo.gq1.ygridcore.net,57016,1377814510039} 2013-08-29 22:15:34,180 INFO [AM.ZK.Worker-pool2-t4] master.RegionStates(299): Onlined 1588230740 on kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:34,231 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2013-08-29 22:15:34,232 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(389): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 connected 2013-08-29 22:15:34,313 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.MasterFileSystem(321): Renamed region directory: hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting 2013-08-29 22:15:34,313 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(1345): dead splitlog workers [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:15:34,316 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(326): Scheduling batch of logs to split 2013-08-29 22:15:34,316 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(328): started splitting 1 logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] 2013-08-29 22:15:34,352 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/splitWAL 2013-08-29 22:15:34,353 DEBUG [RS:1;kiyo:57016-EventThread] regionserver.SplitLogWorker(590): tasks arrived or departed 2013-08-29 22:15:34,353 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(707): put up splitlog task at znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:15:34,355 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 0 2013-08-29 22:15:34,386 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:15:34,386 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(351): worker kiyo.gq1.ygridcore.net,57016,1377814510039 acquired task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:15:34,387 INFO [pool-1-thread-1-EventThread] master.SplitLogManager(822): task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta acquired by kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:34,396 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(253): Splitting hlog: hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta, length=15387 2013-08-29 22:15:34,396 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(254): DistributedLogReplay = true 2013-08-29 22:15:34,435 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:15:34,436 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:15:34,437 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] util.FSHDFSUtils(86): Recovering lease on dfs file hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta 2013-08-29 22:15:34,443 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] util.FSHDFSUtils(173): recoverLease=true, attempt=0 on file=hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta after 6ms 2013-08-29 22:15:34,452 DEBUG [WriterThread-0] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-0,5,main]: starting 2013-08-29 22:15:34,453 DEBUG [WriterThread-2] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-2,5,main]: starting 2013-08-29 22:15:34,452 DEBUG [WriterThread-1] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-1,5,main]: starting 2013-08-29 22:15:34,463 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(340): Finishing writing output logs and closing down. 2013-08-29 22:15:34,464 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter$OutputSink(931): Waiting for split writer threads to finish 2013-08-29 22:15:34,587 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=2 of 35 failed; retrying after sleep of 302 because: org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region is being opened: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2574) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:15:34,760 WARN [RS_OPEN_META-kiyo:57016-0] zookeeper.ZKAssign(866): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Attempt to transition the unassigned node for 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED failed, the node existed and was in the expected state but then when setting data it no longer existed 2013-08-29 22:15:34,761 WARN [RS_OPEN_META-kiyo:57016-0] handler.OpenRegionHandler(370): Completed the OPEN of region hbase:meta,,1.1588230740 but when transitioning from OPENING to OPENED got a version mismatch, someone else clashed so now unassigning -- closing region on server: kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:15:34,761 DEBUG [RS_OPEN_META-kiyo:57016-0] regionserver.HRegion(950): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2013-08-29 22:15:34,761 DEBUG [RS_OPEN_META-kiyo:57016-0] regionserver.HRegion(972): Updates disabled for region hbase:meta,,1.1588230740 2013-08-29 22:15:34,762 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(668): Closed info 2013-08-29 22:15:34,762 INFO [RS_OPEN_META-kiyo:57016-0] regionserver.HRegion(1030): Closed hbase:meta,,1.1588230740 2013-08-29 22:15:34,763 INFO [RS_OPEN_META-kiyo:57016-0] handler.OpenRegionHandler(396): Opening of region {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} failed, transitioning from OPENING to FAILED_OPEN in ZK, expecting version 1 2013-08-29 22:15:34,763 DEBUG [RS_OPEN_META-kiyo:57016-0] zookeeper.ZKAssign(786): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Transitioning 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_FAILED_OPEN 2013-08-29 22:15:34,765 DEBUG [RS_OPEN_META-kiyo:57016-0] zookeeper.ZKUtil(784): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Unable to get data of znode /hbase/region-in-transition/1588230740 because node does not exist (not necessarily an error) 2013-08-29 22:15:34,765 WARN [RS_OPEN_META-kiyo:57016-0] handler.OpenRegionHandler(404): Unable to mark region {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} as FAILED_OPEN. It's likely that the master already timed out this open attempt, and thus another RS already has the region. 2013-08-29 22:15:34,893 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=3 of 35 failed; retrying after sleep of 501 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:15:35,254 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:15:35,397 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=4 of 35 failed; retrying after sleep of 1000 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:15:35,610 WARN [RS:0;kiyo:51291] zookeeper.RecoverableZooKeeper(258): Possibly transient ZooKeeper, quorum=localhost:61251, exception=org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:35,610 INFO [RS:0;kiyo:51291] util.RetryCounter(54): Sleeping 8000ms before retry #3... 2013-08-29 22:15:36,407 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=5 of 35 failed; retrying after sleep of 10047 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:15:40,255 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:15:43,611 WARN [RS:0;kiyo:51291] zookeeper.RecoverableZooKeeper(258): Possibly transient ZooKeeper, quorum=localhost:61251, exception=org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:15:43,612 ERROR [RS:0;kiyo:51291] zookeeper.RecoverableZooKeeper(260): ZooKeeper delete failed after 3 retries 2013-08-29 22:15:43,612 WARN [RS:0;kiyo:51291] regionserver.HRegionServer(957): Failed deleting my ephemeral node org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/kiyo.gq1.ygridcore.net,51291,1377814509998 at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873) at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:158) at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1268) at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1257) at org.apache.hadoop.hbase.regionserver.HRegionServer.deleteMyEphemeralNode(HRegionServer.java:1222) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:955) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:157) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:109) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:141) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:337) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1457) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.hbase.util.Methods.call(Methods.java:41) at org.apache.hadoop.hbase.security.User.call(User.java:420) at org.apache.hadoop.hbase.security.User.access$300(User.java:51) at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:260) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:139) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:15:43,613 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(963): stopping server kiyo.gq1.ygridcore.net,51291,1377814509998; zookeeper connection closed. 2013-08-29 22:15:43,613 INFO [RS:0;kiyo:51291] regionserver.HRegionServer(966): RS:0;kiyo:51291 exiting 2013-08-29 22:15:43,613 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3a33a6b8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(192): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3a33a6b8 2013-08-29 22:15:45,256 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:15:46,417 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=6 of 35 failed; retrying after sleep of 10061 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:15:51,257 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:15:56,451 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=7 of 35 failed; retrying after sleep of 10094 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:15:57,257 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:03,257 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:06,547 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=8 of 35 failed; retrying after sleep of 10003 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:16:08,258 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:13,259 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:16,628 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=9 of 35 failed; retrying after sleep of 10009 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:16:19,259 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:24,260 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:26,681 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=10 of 35 failed; retrying after sleep of 10021 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:16:29,261 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:34,262 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:36,731 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=11 of 35 failed; retrying after sleep of 10066 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:16:39,263 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:44,264 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:46,819 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=12 of 35 failed; retrying after sleep of 10065 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:16:49,265 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:55,265 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:16:56,921 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=13 of 35 failed; retrying after sleep of 10047 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:17:00,266 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:05,268 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:06,953 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=14 of 35 failed; retrying after sleep of 10073 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:17:10,270 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:15,271 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:17,003 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=15 of 35 failed; retrying after sleep of 10072 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:17:20,272 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:25,273 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:27,025 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=16 of 35 failed; retrying after sleep of 10083 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:17:30,274 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814534437 last_version = 2 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:35,275 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager(871): resubmitting task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:17:35,281 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:17:35,282 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:17:35,283 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655282 last_version = 2 cur_worker_name = null status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:35,283 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1408): resubmitted 1 out of 1 tasks 2013-08-29 22:17:35,283 INFO [RS:1;kiyo:57016-EventThread] regionserver.SplitLogWorker(517): task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta preempted from kiyo.gq1.ygridcore.net,57016,1377814510039, current task state and owner=UNASSIGNED kiyo.gq1.ygridcore.net,44745,1377814506185 2013-08-29 22:17:35,283 INFO [RS:1;kiyo:57016-EventThread] regionserver.SplitLogWorker(603): Sending interrupt to stop the worker thread 2013-08-29 22:17:35,283 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 3 2013-08-29 22:17:35,283 ERROR [WriterThread-1] wal.HLogSplitter$WriterThread(799): Exiting thread java.io.IOException: Interrupted when waiting regon 1588230740 online. at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.waitUntilRegionOnline(HLogSplitter.java:1652) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.locateRegionAndRefreshLastFlushedSequenceId(HLogSplitter.java:1547) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.groupEditsByServer(HLogSplitter.java:1444) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.append(HLogSplitter.java:1356) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.writeBuffer(HLogSplitter.java:835) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.doRun(HLogSplitter.java:827) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.run(HLogSplitter.java:797) Caused by: java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.waitUntilRegionOnline(HLogSplitter.java:1649) ... 6 more 2013-08-29 22:17:35,284 WARN [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker$1(143): log splitting of WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta interrupted, resigning java.io.InterruptedIOException at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$OutputSink.finishWriting(HLogSplitter.java:943) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.finishWritingAndClose(HLogSplitter.java:1696) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFile(HLogSplitter.java:342) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFile(HLogSplitter.java:206) at org.apache.hadoop.hbase.regionserver.SplitLogWorker$1.exec(SplitLogWorker.java:138) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.grabTask(SplitLogWorker.java:358) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop(SplitLogWorker.java:245) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:205) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1186) at java.lang.Thread.join(Thread.java:1239) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$OutputSink.finishWriting(HLogSplitter.java:941) ... 8 more 2013-08-29 22:17:35,306 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/splitWAL 2013-08-29 22:17:35,306 DEBUG [RS:1;kiyo:57016-EventThread] regionserver.SplitLogWorker(590): tasks arrived or departed 2013-08-29 22:17:35,326 WARN [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(476): transisition task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta to RESIGNED kiyo.gq1.ygridcore.net,57016,1377814510039 failed because of version mismatch org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta at org.apache.zookeeper.KeeperException.create(KeeperException.java:115) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1266) at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.setData(RecoverableZooKeeper.java:416) at org.apache.hadoop.hbase.zookeeper.ZKUtil.setData(ZKUtil.java:884) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.endTask(SplitLogWorker.java:467) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.grabTask(SplitLogWorker.java:397) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop(SplitLogWorker.java:245) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:205) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:17:35,327 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(403): worker kiyo.gq1.ygridcore.net,57016,1377814510039 done with task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta in 120940ms 2013-08-29 22:17:35,327 INFO [pool-1-thread-1-EventThread] master.SplitLogManager(757): task /hbase/splitWAL/RESCAN0000000001 entered state: DONE kiyo.gq1.ygridcore.net,44745,1377814506185 2013-08-29 22:17:35,339 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/splitWAL 2013-08-29 22:17:35,339 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL/RESCAN0000000001 2013-08-29 22:17:35,339 DEBUG [RS:1;kiyo:57016-EventThread] regionserver.SplitLogWorker(590): tasks arrived or departed 2013-08-29 22:17:35,340 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$DeleteAsyncCallback(1601): deleted /hbase/splitWAL/RESCAN0000000001 2013-08-29 22:17:35,340 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(939): deleted task without in memory state /hbase/splitWAL/RESCAN0000000001 2013-08-29 22:17:35,348 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:17:35,348 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:17:35,348 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(351): worker kiyo.gq1.ygridcore.net,57016,1377814510039 acquired task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:17:35,349 INFO [pool-1-thread-1-EventThread] master.SplitLogManager(822): task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta acquired by kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:17:35,352 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(253): Splitting hlog: hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta, length=15387 2013-08-29 22:17:35,352 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(254): DistributedLogReplay = true 2013-08-29 22:17:35,356 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:17:35,356 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:17:35,356 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] util.FSHDFSUtils(86): Recovering lease on dfs file hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta 2013-08-29 22:17:35,358 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] util.FSHDFSUtils(173): recoverLease=true, attempt=0 on file=hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta after 2ms 2013-08-29 22:17:35,365 DEBUG [WriterThread-0] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-0,5,main]: starting 2013-08-29 22:17:35,365 DEBUG [WriterThread-2] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-2,5,main]: starting 2013-08-29 22:17:35,365 DEBUG [WriterThread-1] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-1,5,main]: starting 2013-08-29 22:17:35,373 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(340): Finishing writing output logs and closing down. 2013-08-29 22:17:35,373 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter$OutputSink(931): Waiting for split writer threads to finish 2013-08-29 22:17:37,052 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=17 of 35 failed; retrying after sleep of 10097 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:17:41,276 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:46,279 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:47,078 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=18 of 35 failed; retrying after sleep of 10050 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:17:52,280 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:17:57,179 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=19 of 35 failed; retrying after sleep of 10081 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:17:58,280 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:03,281 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:07,243 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=20 of 35 failed; retrying after sleep of 10055 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:18:09,281 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:14,282 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:17,335 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=21 of 35 failed; retrying after sleep of 10038 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:18:20,283 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:25,284 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:27,415 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=22 of 35 failed; retrying after sleep of 10000 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:18:31,285 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:37,285 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:37,434 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=23 of 35 failed; retrying after sleep of 10082 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:18:43,286 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:47,461 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=24 of 35 failed; retrying after sleep of 10084 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:18:49,287 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:54,292 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:18:57,547 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=25 of 35 failed; retrying after sleep of 10016 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:19:00,292 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:05,293 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:07,646 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=26 of 35 failed; retrying after sleep of 10026 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:19:10,294 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:15,295 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:17,655 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=27 of 35 failed; retrying after sleep of 10012 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:19:21,294 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:26,295 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:27,733 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=28 of 35 failed; retrying after sleep of 10006 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:19:31,296 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814655357 last_version = 5 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 1 resubmits = 1 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:36,296 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager(871): resubmitting task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:19:36,343 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:19:36,344 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:19:36,345 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = -1 last_version = 5 cur_worker_name = null status = in_progress incarnation = 2 resubmits = 2 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:36,345 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1408): resubmitted 1 out of 1 tasks 2013-08-29 22:19:36,346 INFO [RS:1;kiyo:57016-EventThread] regionserver.SplitLogWorker(517): task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta preempted from kiyo.gq1.ygridcore.net,57016,1377814510039, current task state and owner=UNASSIGNED kiyo.gq1.ygridcore.net,44745,1377814506185 2013-08-29 22:19:36,346 INFO [RS:1;kiyo:57016-EventThread] regionserver.SplitLogWorker(603): Sending interrupt to stop the worker thread 2013-08-29 22:19:36,346 ERROR [WriterThread-1] wal.HLogSplitter$WriterThread(799): Exiting thread java.io.IOException: Interrupted when waiting regon 1588230740 online. at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.waitUntilRegionOnline(HLogSplitter.java:1652) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.locateRegionAndRefreshLastFlushedSequenceId(HLogSplitter.java:1547) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.groupEditsByServer(HLogSplitter.java:1444) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.append(HLogSplitter.java:1356) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.writeBuffer(HLogSplitter.java:835) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.doRun(HLogSplitter.java:827) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.run(HLogSplitter.java:797) Caused by: java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.waitUntilRegionOnline(HLogSplitter.java:1649) ... 6 more 2013-08-29 22:19:36,347 WARN [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker$1(143): log splitting of WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta interrupted, resigning java.io.InterruptedIOException at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$OutputSink.finishWriting(HLogSplitter.java:943) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.finishWritingAndClose(HLogSplitter.java:1696) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFile(HLogSplitter.java:342) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFile(HLogSplitter.java:206) at org.apache.hadoop.hbase.regionserver.SplitLogWorker$1.exec(SplitLogWorker.java:138) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.grabTask(SplitLogWorker.java:358) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop(SplitLogWorker.java:245) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:205) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1186) at java.lang.Thread.join(Thread.java:1239) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$OutputSink.finishWriting(HLogSplitter.java:941) ... 8 more 2013-08-29 22:19:36,377 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 6 2013-08-29 22:19:36,405 WARN [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(476): transisition task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta to RESIGNED kiyo.gq1.ygridcore.net,57016,1377814510039 failed because of version mismatch org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta at org.apache.zookeeper.KeeperException.create(KeeperException.java:115) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1266) at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.setData(RecoverableZooKeeper.java:416) at org.apache.hadoop.hbase.zookeeper.ZKUtil.setData(ZKUtil.java:884) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.endTask(SplitLogWorker.java:467) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.grabTask(SplitLogWorker.java:397) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop(SplitLogWorker.java:245) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:205) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:19:36,406 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(403): worker kiyo.gq1.ygridcore.net,57016,1377814510039 done with task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta in 121058ms 2013-08-29 22:19:36,405 INFO [pool-1-thread-1-EventThread] master.SplitLogManager(757): task /hbase/splitWAL/RESCAN0000000002 entered state: DONE kiyo.gq1.ygridcore.net,44745,1377814506185 2013-08-29 22:19:36,407 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] zookeeper.ZKUtil(784): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Unable to get data of znode /hbase/splitWAL/RESCAN0000000001 because node does not exist (not necessarily an error) 2013-08-29 22:19:36,435 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL/RESCAN0000000002 2013-08-29 22:19:36,436 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$DeleteAsyncCallback(1601): deleted /hbase/splitWAL/RESCAN0000000002 2013-08-29 22:19:36,436 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(939): deleted task without in memory state /hbase/splitWAL/RESCAN0000000002 2013-08-29 22:19:36,485 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:19:36,485 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:19:36,485 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(351): worker kiyo.gq1.ygridcore.net,57016,1377814510039 acquired task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:19:36,487 INFO [pool-1-thread-1-EventThread] master.SplitLogManager(822): task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta acquired by kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:19:36,490 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(253): Splitting hlog: hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta, length=15387 2013-08-29 22:19:36,490 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(254): DistributedLogReplay = true 2013-08-29 22:19:36,543 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:19:36,543 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:19:36,544 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] util.FSHDFSUtils(86): Recovering lease on dfs file hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta 2013-08-29 22:19:36,545 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] util.FSHDFSUtils(173): recoverLease=true, attempt=0 on file=hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta after 1ms 2013-08-29 22:19:36,555 DEBUG [WriterThread-0] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-0,5,main]: starting 2013-08-29 22:19:36,555 DEBUG [WriterThread-2] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-2,5,main]: starting 2013-08-29 22:19:36,555 DEBUG [WriterThread-1] wal.HLogSplitter$WriterThread(805): Writer thread Thread[WriterThread-1,5,main]: starting 2013-08-29 22:19:36,566 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter(340): Finishing writing output logs and closing down. 2013-08-29 22:19:36,567 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] wal.HLogSplitter$OutputSink(931): Waiting for split writer threads to finish 2013-08-29 22:19:37,762 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=29 of 35 failed; retrying after sleep of 10049 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:19:42,297 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814776545 last_version = 8 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 2 resubmits = 2 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:47,809 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=30 of 35 failed; retrying after sleep of 10025 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:19:48,298 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814776545 last_version = 8 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 2 resubmits = 2 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:53,299 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814776545 last_version = 8 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 2 resubmits = 2 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:19:57,880 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=31 of 35 failed; retrying after sleep of 10088 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:19:58,300 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814776545 last_version = 8 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 2 resubmits = 2 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:20:03,301 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814776545 last_version = 8 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 2 resubmits = 2 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:20:07,919 DEBUG [Thread-221] client.HConnectionManager$HConnectionImplementation(1269): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,57016,1377814510039, seqNum=0}, attempt=32 of 35 failed; retrying after sleep of 10020 because: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: 1588230740 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2576) at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3949) at org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2733) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26965) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2063) at org.apache.hadoop.hbase.ipc.RpcServer$CallRunner.run(RpcServer.java:1800) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:165) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:41) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:113) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:20:08,302 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814776545 last_version = 8 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 2 resubmits = 2 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:20:14,301 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1404): total tasks = 1 unassigned = 0 tasks={/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta=last_update = 1377814776545 last_version = 8 cur_worker_name = kiyo.gq1.ygridcore.net,57016,1377814510039 status = in_progress incarnation = 2 resubmits = 2 batch = installed = 1 done = 0 error = 0} 2013-08-29 22:20:16,814 DEBUG [kiyo.gq1.ygridcore.net,44745,1377814506185-BalancerChore] master.HMaster(1518): Not running balancer because processing dead regionserver(s): kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:16,817 DEBUG [NamespaceJanitor-kiyo:44745] client.HConnectionManager$HConnectionImplementation(1392): Removed all cached region locations that map to kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:16,820 DEBUG [RpcServer.handler=0,port=57016] regionserver.HRegionServer(2606): NotServingRegionException; Region is not online: 1588230740 2013-08-29 22:20:17,039 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: TestFullLogReconstruction#testReconstruction Thread=200 (was 243), OpenFileDescriptor=335 (was 418), MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=553 (was 504) - SystemLoadAverage LEAK? -, ProcessCount=502 (was 502), AvailableMemoryMB=5046 (was 4820) - AvailableMemoryMB LEAK? -, ConnectionCount=5 (was 6) 2013-08-29 22:20:17,039 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(938): Shutting down minicluster 2013-08-29 22:20:17,039 DEBUG [pool-1-thread-1] util.JVMClusterUtil(237): Shutting down HBase Cluster 2013-08-29 22:20:17,041 INFO [pool-1-thread-1] master.HMaster(2447): Cluster shutdown requested 2013-08-29 22:20:17,041 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185-ClusterStatusChore] hbase.Chore(93): kiyo.gq1.ygridcore.net,44745,1377814506185-ClusterStatusChore exiting 2013-08-29 22:20:17,041 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185-BalancerChore] hbase.Chore(93): kiyo.gq1.ygridcore.net,44745,1377814506185-BalancerChore exiting 2013-08-29 22:20:17,041 WARN [NamespaceJanitor-kiyo:44745] master.NamespaceJanitor(91): Failed NamespaceJanitor chore java.io.InterruptedIOException: Interrupted after 0 tries on 350 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:153) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:96) at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:239) at org.apache.hadoop.hbase.client.ClientScanner.(ClientScanner.java:153) at org.apache.hadoop.hbase.client.ClientScanner.(ClientScanner.java:100) at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:696) at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:707) at org.apache.hadoop.hbase.master.TableNamespaceManager.list(TableNamespaceManager.java:185) at org.apache.hadoop.hbase.master.HMaster.listNamespaceDescriptors(HMaster.java:3162) at org.apache.hadoop.hbase.master.NamespaceJanitor.removeOrphans(NamespaceJanitor.java:102) at org.apache.hadoop.hbase.master.NamespaceJanitor.chore(NamespaceJanitor.java:86) at org.apache.hadoop.hbase.Chore.run(Chore.java:80) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:20:17,041 INFO [NamespaceJanitor-kiyo:44745] hbase.Chore(93): NamespaceJanitor-kiyo:44745 exiting 2013-08-29 22:20:17,041 WARN [CatalogJanitor-kiyo:44745] master.CatalogJanitor(106): Failed scan of catalog table java.io.InterruptedIOException: Interrupted after 0 tries on 350 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:153) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:96) at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:239) at org.apache.hadoop.hbase.client.ClientScanner.(ClientScanner.java:153) at org.apache.hadoop.hbase.client.ClientScanner.(ClientScanner.java:100) at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:696) at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:174) at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:82) at org.apache.hadoop.hbase.master.CatalogJanitor.getMergedRegionsAndSplitParents(CatalogJanitor.java:167) at org.apache.hadoop.hbase.master.CatalogJanitor.getMergedRegionsAndSplitParents(CatalogJanitor.java:119) at org.apache.hadoop.hbase.master.CatalogJanitor.scan(CatalogJanitor.java:220) at org.apache.hadoop.hbase.master.CatalogJanitor.chore(CatalogJanitor.java:101) at org.apache.hadoop.hbase.Chore.run(Chore.java:80) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:20:17,042 INFO [CatalogJanitor-kiyo:44745] hbase.Chore(93): CatalogJanitor-kiyo:44745 exiting 2013-08-29 22:20:17,041 INFO [M:0;kiyo:44745] master.ServerManager(447): Waiting on regionserver(s) to go down kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:17,061 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2013-08-29 22:20:17,061 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2013-08-29 22:20:17,061 INFO [pool-1-thread-1] regionserver.HRegionServer(1673): STOPPED: Shutdown requested 2013-08-29 22:20:17,061 INFO [pool-1-thread-1] regionserver.HRegionServer(1673): STOPPED: Shutdown requested 2013-08-29 22:20:17,062 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(433): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Set watcher on znode that does not yet exist, /hbase/running 2013-08-29 22:20:17,062 INFO [RS:1;kiyo:57016] regionserver.SplitLogWorker(603): Sending interrupt to stop the worker thread 2013-08-29 22:20:17,062 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZKUtil(433): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Set watcher on znode that does not yet exist, /hbase/running 2013-08-29 22:20:17,063 INFO [Thread-152] regionserver.MemStoreFlusher$FlushHandler(269): Thread-152 exiting 2013-08-29 22:20:17,063 INFO [RS:1;kiyo:57016.compactionChecker] hbase.Chore(93): RS:1;kiyo:57016.compactionChecker exiting 2013-08-29 22:20:17,063 INFO [RS_OPEN_META-kiyo:57016-0-MetaLogRoller] regionserver.LogRoller(119): LogRoller exiting. 2013-08-29 22:20:17,063 INFO [RS:1;kiyo:57016.logRoller] regionserver.LogRoller(119): LogRoller exiting. 2013-08-29 22:20:17,063 ERROR [WriterThread-1] wal.HLogSplitter$WriterThread(799): Exiting thread java.io.IOException: Interrupted when waiting regon 1588230740 online. at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.waitUntilRegionOnline(HLogSplitter.java:1652) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.locateRegionAndRefreshLastFlushedSequenceId(HLogSplitter.java:1547) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.groupEditsByServer(HLogSplitter.java:1444) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.append(HLogSplitter.java:1356) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.writeBuffer(HLogSplitter.java:835) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.doRun(HLogSplitter.java:827) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$WriterThread.run(HLogSplitter.java:797) Caused by: java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.waitUntilRegionOnline(HLogSplitter.java:1649) ... 6 more 2013-08-29 22:20:17,063 INFO [RS:1;kiyo:57016] snapshot.RegionServerSnapshotManager(152): Stopping RegionServerSnapshotManager gracefully. 2013-08-29 22:20:17,065 WARN [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker$1(143): log splitting of WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting/kiyo.gq1.ygridcore.net%2C51291%2C1377814509998.1377814515397.meta interrupted, resigning java.io.InterruptedIOException at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$OutputSink.finishWriting(HLogSplitter.java:943) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$LogReplayOutputSink.finishWritingAndClose(HLogSplitter.java:1696) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFile(HLogSplitter.java:342) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLogFile(HLogSplitter.java:206) at org.apache.hadoop.hbase.regionserver.SplitLogWorker$1.exec(SplitLogWorker.java:138) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.grabTask(SplitLogWorker.java:358) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop(SplitLogWorker.java:245) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:205) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1186) at java.lang.Thread.join(Thread.java:1239) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter$OutputSink.finishWriting(HLogSplitter.java:941) ... 8 more 2013-08-29 22:20:17,066 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(125): Processing close of tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:20:17,067 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(395): task execution interrupted because worker is exiting /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:17,067 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(950): Closing tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b.: disabling compactions & flushes 2013-08-29 22:20:17,067 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] handler.CloseRegionHandler(125): Processing close of tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:20:17,067 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(972): Updates disabled for region tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:20:17,067 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(915): stopping server kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:17,068 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1475): Started memstore flush for tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b., current region memstore size 576.7 K 2013-08-29 22:20:17,067 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] handler.CloseRegionHandler(125): Processing close of tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:20:17,068 DEBUG [RS:1;kiyo:57016] catalog.CatalogTracker(208): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@55264c84 2013-08-29 22:20:17,068 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(950): Closing tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2.: disabling compactions & flushes 2013-08-29 22:20:17,069 INFO [RS:1;kiyo:57016] client.HConnectionManager$HConnectionImplementation(1926): Closing zookeeper sessionid=0x140cc24e86a0005 2013-08-29 22:20:17,069 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(972): Updates disabled for region tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:20:17,069 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(950): Closing tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2.: disabling compactions & flushes 2013-08-29 22:20:17,070 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1475): Started memstore flush for tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2., current region memstore size 576.7 K 2013-08-29 22:20:17,070 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(972): Updates disabled for region tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:20:17,070 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1475): Started memstore flush for tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2., current region memstore size 576.7 K 2013-08-29 22:20:17,093 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(439): Stopped while waiting for log splits to be completed 2013-08-29 22:20:17,094 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:17,094 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:17,094 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(469): successfully transitioned task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta to final state RESIGNED kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:17,094 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(403): worker kiyo.gq1.ygridcore.net,57016,1377814510039 done with task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta in 40608ms 2013-08-29 22:20:17,094 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,57016,1377814510039] regionserver.SplitLogWorker(212): SplitLogWorker kiyo.gq1.ygridcore.net,57016,1377814510039 exiting 2013-08-29 22:20:17,126 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(1075): Waiting on 12 regions to close 2013-08-29 22:20:17,127 INFO [pool-1-thread-1-EventThread] master.SplitLogManager(754): task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta entered state: RESIGNED kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:17,127 INFO [pool-1-thread-1-EventThread] master.SplitLogManager(871): resubmitting task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:17,159 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:17,301 INFO [kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor] hbase.Chore(93): kiyo.gq1.ygridcore.net,44745,1377814506185.splitLogManagerTimeoutMonitor exiting 2013-08-29 22:20:17,421 INFO [RS:1;kiyo:57016.periodicFlusher] hbase.Chore(93): RS:1;kiyo:57016.periodicFlusher exiting 2013-08-29 22:20:17,423 INFO [RS:1;kiyo:57016.leaseChecker] regionserver.Leases(147): RS:1;kiyo:57016.leaseChecker closing leases 2013-08-29 22:20:17,423 INFO [RS:1;kiyo:57016.leaseChecker] regionserver.Leases(150): RS:1;kiyo:57016.leaseChecker closed leases 2013-08-29 22:20:17,535 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/splitWAL 2013-08-29 22:20:17,535 DEBUG [RS:1;kiyo:57016-EventThread] regionserver.SplitLogWorker(590): tasks arrived or departed 2013-08-29 22:20:17,536 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 10 2013-08-29 22:20:17,537 INFO [pool-1-thread-1-EventThread] master.SplitLogManager(757): task /hbase/splitWAL/RESCAN0000000003 entered state: DONE kiyo.gq1.ygridcore.net,44745,1377814506185 2013-08-29 22:20:17,576 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL/RESCAN0000000003 2013-08-29 22:20:17,576 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$DeleteAsyncCallback(1601): deleted /hbase/splitWAL/RESCAN0000000003 2013-08-29 22:20:17,576 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(939): deleted task without in memory state /hbase/splitWAL/RESCAN0000000003 2013-08-29 22:20:17,582 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:20:17,584 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741862_1038 size 23952 2013-08-29 22:20:17,617 INFO [IPC Server handler 2 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:20:17,618 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741864_1040{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 23952 2013-08-29 22:20:17,619 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741864_1040 size 23952 2013-08-29 22:20:17,619 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741863_1039 size 23952 2013-08-29 22:20:17,630 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=72, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/68a7538716d8db76c6342305e700744b/.tmp/9eb4e699d565484ca3a874ebb08440e8 2013-08-29 22:20:17,658 DEBUG [RS:1;kiyo:57016-EventThread] zookeeper.ZooKeeperWatcher(312): regionserver:57016-0x140cc24e86a0003-0x140cc24e86a0003 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/recovering-regions/1588230740 2013-08-29 22:20:17,658 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(357): error while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] installed = 1 but only 0 done 2013-08-29 22:20:17,658 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] executor.EventHandler(134): Caught throwable while processing event M_META_SERVER_SHUTDOWN java.io.IOException: failed log splitting for kiyo.gq1.ygridcore.net,51291,1377814509998, will retry at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:105) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.IOException: error or interrupted while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] Task = installed = 1 done = 0 error = 0 at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:362) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) ... 4 more 2013-08-29 22:20:17,659 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] handler.MetaServerShutdownHandler(59): Splitting META logs for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:17,660 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] zookeeper.ZKUtil(690): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2013-08-29 22:20:17,663 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/68a7538716d8db76c6342305e700744b/.tmp/9eb4e699d565484ca3a874ebb08440e8 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/68a7538716d8db76c6342305e700744b/family/9eb4e699d565484ca3a874ebb08440e8 2013-08-29 22:20:17,686 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=74, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/60dd6b689221b85fed89c65d2cfd13b2/.tmp/0db9b3572042418bbf441ed892964607 2013-08-29 22:20:17,701 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/60dd6b689221b85fed89c65d2cfd13b2/.tmp/0db9b3572042418bbf441ed892964607 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/60dd6b689221b85fed89c65d2cfd13b2/family/0db9b3572042418bbf441ed892964607 2013-08-29 22:20:17,755 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/68a7538716d8db76c6342305e700744b/family/9eb4e699d565484ca3a874ebb08440e8, entries=703, sequenceid=72, filesize=23.4 K 2013-08-29 22:20:17,756 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. in 687ms, sequenceid=72, compaction requested=false 2013-08-29 22:20:17,759 INFO [StoreCloserThread-tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:17,759 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1030): Closed tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:20:17,759 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(176): Closed tabletest,uuu,1377814517552.68a7538716d8db76c6342305e700744b. 2013-08-29 22:20:17,759 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(125): Processing close of tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:20:17,761 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(950): Closing tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0.: disabling compactions & flushes 2013-08-29 22:20:17,761 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(972): Updates disabled for region tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:20:17,761 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1475): Started memstore flush for tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0., current region memstore size 576.7 K 2013-08-29 22:20:17,766 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(1159): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:17,767 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,57016,1377814510039 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:17,768 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] handler.MetaServerShutdownHandler(87): META has been assigned to otherwhere, skip assigning. 2013-08-29 22:20:17,770 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(1345): dead splitlog workers [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:20:17,773 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(326): Scheduling batch of logs to split 2013-08-29 22:20:17,774 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(328): started splitting 1 logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] 2013-08-29 22:20:17,774 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(1013): Previously orphan task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta is now being waited upon 2013-08-29 22:20:17,805 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/60dd6b689221b85fed89c65d2cfd13b2/family/0db9b3572042418bbf441ed892964607, entries=703, sequenceid=74, filesize=23.4 K 2013-08-29 22:20:17,805 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. in 735ms, sequenceid=74, compaction requested=false 2013-08-29 22:20:17,807 INFO [StoreCloserThread-tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:17,808 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$CreateAsyncCallback(1491): found pre-existing znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:17,808 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1030): Closed tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:20:17,808 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(707): put up splitlog task at znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:17,808 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] handler.CloseRegionHandler(176): Closed tabletest,nnn,1377814517517.60dd6b689221b85fed89c65d2cfd13b2. 2013-08-29 22:20:17,808 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] handler.CloseRegionHandler(125): Processing close of tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:20:17,809 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(950): Closing tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa.: disabling compactions & flushes 2013-08-29 22:20:17,809 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 10 2013-08-29 22:20:17,809 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(972): Updates disabled for region tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:20:17,809 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1475): Started memstore flush for tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa., current region memstore size 576.7 K 2013-08-29 22:20:17,908 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(439): Stopped while waiting for log splits to be completed 2013-08-29 22:20:17,973 INFO [IPC Server handler 6 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:17,974 INFO [IPC Server handler 1 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741865_1041 size 23952 2013-08-29 22:20:18,008 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(357): error while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] installed = 1 but only 0 done 2013-08-29 22:20:18,009 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] executor.EventHandler(134): Caught throwable while processing event M_META_SERVER_SHUTDOWN java.io.IOException: failed log splitting for kiyo.gq1.ygridcore.net,51291,1377814509998, will retry at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:105) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.IOException: error or interrupted while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] Task = installed = 1 done = 0 error = 0 at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:362) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) ... 4 more 2013-08-29 22:20:18,009 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] handler.MetaServerShutdownHandler(59): Splitting META logs for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,010 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] zookeeper.ZKUtil(690): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2013-08-29 22:20:18,044 INFO [M:0;kiyo:44745] master.ServerManager(447): Waiting on regionserver(s) to go down kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:18,044 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:18,045 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741866_1042 size 23952 2013-08-29 22:20:18,085 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=73, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/9726b1bb649d384a3531183536e758f2/.tmp/fbc7a4c0260642bb97c344ab329de112 2013-08-29 22:20:18,086 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=75, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/407a01405eb76853035e2d90869eecf0/.tmp/cb502d6196594286a209e150dc1de5c2 2013-08-29 22:20:18,104 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/9726b1bb649d384a3531183536e758f2/.tmp/fbc7a4c0260642bb97c344ab329de112 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/9726b1bb649d384a3531183536e758f2/family/fbc7a4c0260642bb97c344ab329de112 2013-08-29 22:20:18,105 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/407a01405eb76853035e2d90869eecf0/.tmp/cb502d6196594286a209e150dc1de5c2 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/407a01405eb76853035e2d90869eecf0/family/cb502d6196594286a209e150dc1de5c2 2013-08-29 22:20:18,116 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(1159): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,117 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,57016,1377814510039 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,118 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] handler.MetaServerShutdownHandler(87): META has been assigned to otherwhere, skip assigning. 2013-08-29 22:20:18,119 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(1345): dead splitlog workers [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:20:18,121 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(326): Scheduling batch of logs to split 2013-08-29 22:20:18,121 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(328): started splitting 1 logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] 2013-08-29 22:20:18,122 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(1013): Previously orphan task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta is now being waited upon 2013-08-29 22:20:18,128 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(1075): Waiting on 10 regions to close 2013-08-29 22:20:18,144 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=76, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e16cb91aec0ea3dd068fbaf236ee81fa/.tmp/9e6d0a31fce34a28806e74ca9b63ec34 2013-08-29 22:20:18,157 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e16cb91aec0ea3dd068fbaf236ee81fa/.tmp/9e6d0a31fce34a28806e74ca9b63ec34 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e16cb91aec0ea3dd068fbaf236ee81fa/family/9e6d0a31fce34a28806e74ca9b63ec34 2013-08-29 22:20:18,191 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$CreateAsyncCallback(1491): found pre-existing znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:18,191 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(707): put up splitlog task at znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:18,192 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 10 2013-08-29 22:20:18,224 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/407a01405eb76853035e2d90869eecf0/family/cb502d6196594286a209e150dc1de5c2, entries=703, sequenceid=75, filesize=23.4 K 2013-08-29 22:20:18,225 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. in 464ms, sequenceid=75, compaction requested=false 2013-08-29 22:20:18,227 INFO [StoreCloserThread-tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:18,227 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1030): Closed tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:20:18,227 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(176): Closed tabletest,sss,1377814517543.407a01405eb76853035e2d90869eecf0. 2013-08-29 22:20:18,227 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(125): Processing close of tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:20:18,228 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(950): Closing tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217.: disabling compactions & flushes 2013-08-29 22:20:18,228 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(972): Updates disabled for region tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:20:18,228 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1475): Started memstore flush for tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217., current region memstore size 576.7 K 2013-08-29 22:20:18,231 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/9726b1bb649d384a3531183536e758f2/family/fbc7a4c0260642bb97c344ab329de112, entries=703, sequenceid=73, filesize=23.4 K 2013-08-29 22:20:18,232 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. in 1163ms, sequenceid=73, compaction requested=false 2013-08-29 22:20:18,233 INFO [StoreCloserThread-tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:18,233 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1030): Closed tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:20:18,233 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] handler.CloseRegionHandler(176): Closed tabletest,fff,1377814517478.9726b1bb649d384a3531183536e758f2. 2013-08-29 22:20:18,234 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] handler.CloseRegionHandler(125): Processing close of tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:20:18,234 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(950): Closing tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4.: disabling compactions & flushes 2013-08-29 22:20:18,234 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(972): Updates disabled for region tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:20:18,234 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1475): Started memstore flush for tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4., current region memstore size 576.7 K 2013-08-29 22:20:18,270 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e16cb91aec0ea3dd068fbaf236ee81fa/family/9e6d0a31fce34a28806e74ca9b63ec34, entries=703, sequenceid=76, filesize=23.4 K 2013-08-29 22:20:18,270 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. in 461ms, sequenceid=76, compaction requested=false 2013-08-29 22:20:18,272 INFO [StoreCloserThread-tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:18,273 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1030): Closed tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:20:18,273 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] handler.CloseRegionHandler(176): Closed tabletest,bbb,1377814517459.e16cb91aec0ea3dd068fbaf236ee81fa. 2013-08-29 22:20:18,273 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] handler.CloseRegionHandler(125): Processing close of tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:20:18,273 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(950): Closing tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6.: disabling compactions & flushes 2013-08-29 22:20:18,274 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(972): Updates disabled for region tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:20:18,274 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1475): Started memstore flush for tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6., current region memstore size 576.7 K 2013-08-29 22:20:18,292 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(439): Stopped while waiting for log splits to be completed 2013-08-29 22:20:18,401 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(357): error while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] installed = 1 but only 0 done 2013-08-29 22:20:18,401 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] executor.EventHandler(134): Caught throwable while processing event M_META_SERVER_SHUTDOWN java.io.IOException: failed log splitting for kiyo.gq1.ygridcore.net,51291,1377814509998, will retry at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:105) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.IOException: error or interrupted while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] Task = installed = 1 done = 0 error = 0 at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:362) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) ... 4 more 2013-08-29 22:20:18,402 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] handler.MetaServerShutdownHandler(59): Splitting META logs for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,403 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] zookeeper.ZKUtil(690): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2013-08-29 22:20:18,456 INFO [IPC Server handler 0 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:18,458 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741867_1043 size 23952 2013-08-29 22:20:18,462 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:20:18,463 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741868_1044 size 23952 2013-08-29 22:20:18,492 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:18,493 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741869_1045 size 23952 2013-08-29 22:20:18,509 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] master.SplitLogManager(1159): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,510 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,57016,1377814510039 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,511 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] handler.MetaServerShutdownHandler(87): META has been assigned to otherwhere, skip assigning. 2013-08-29 22:20:18,514 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] master.SplitLogManager(1345): dead splitlog workers [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:20:18,516 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] master.SplitLogManager(326): Scheduling batch of logs to split 2013-08-29 22:20:18,516 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] master.SplitLogManager(328): started splitting 1 logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] 2013-08-29 22:20:18,517 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] master.SplitLogManager(1013): Previously orphan task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta is now being waited upon 2013-08-29 22:20:18,559 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=78, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/16d9fd46b6932e1be21e5e7f4dd79ac4/.tmp/e19129b5b3684463a6189d2b2bfc59e0 2013-08-29 22:20:18,559 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$CreateAsyncCallback(1491): found pre-existing znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:18,559 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(707): put up splitlog task at znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:18,560 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=77, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e216da715f0e1cbfad4a22d737c61217/.tmp/8b2c6662d5084f93a56507115c7068d9 2013-08-29 22:20:18,560 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 10 2013-08-29 22:20:18,577 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/16d9fd46b6932e1be21e5e7f4dd79ac4/.tmp/e19129b5b3684463a6189d2b2bfc59e0 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/16d9fd46b6932e1be21e5e7f4dd79ac4/family/e19129b5b3684463a6189d2b2bfc59e0 2013-08-29 22:20:18,578 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e216da715f0e1cbfad4a22d737c61217/.tmp/8b2c6662d5084f93a56507115c7068d9 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e216da715f0e1cbfad4a22d737c61217/family/8b2c6662d5084f93a56507115c7068d9 2013-08-29 22:20:18,609 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=79, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e0f77722c886c7dbde9efcde4f60c2c6/.tmp/db79fdea786e49849d37581a77205063 2013-08-29 22:20:18,621 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e0f77722c886c7dbde9efcde4f60c2c6/.tmp/db79fdea786e49849d37581a77205063 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e0f77722c886c7dbde9efcde4f60c2c6/family/db79fdea786e49849d37581a77205063 2013-08-29 22:20:18,660 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] master.SplitLogManager(439): Stopped while waiting for log splits to be completed 2013-08-29 22:20:18,664 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e216da715f0e1cbfad4a22d737c61217/family/8b2c6662d5084f93a56507115c7068d9, entries=703, sequenceid=77, filesize=23.4 K 2013-08-29 22:20:18,665 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. in 436ms, sequenceid=77, compaction requested=false 2013-08-29 22:20:18,667 INFO [StoreCloserThread-tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:18,667 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1030): Closed tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:20:18,668 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(176): Closed tabletest,www,1377814517561.e216da715f0e1cbfad4a22d737c61217. 2013-08-29 22:20:18,668 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(125): Processing close of tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:20:18,668 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(950): Closing tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798.: disabling compactions & flushes 2013-08-29 22:20:18,668 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(972): Updates disabled for region tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:20:18,668 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1475): Started memstore flush for tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798., current region memstore size 576.7 K 2013-08-29 22:20:18,672 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/16d9fd46b6932e1be21e5e7f4dd79ac4/family/e19129b5b3684463a6189d2b2bfc59e0, entries=703, sequenceid=78, filesize=23.4 K 2013-08-29 22:20:18,672 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. in 438ms, sequenceid=78, compaction requested=false 2013-08-29 22:20:18,674 INFO [StoreCloserThread-tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:18,675 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1030): Closed tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:20:18,675 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] handler.CloseRegionHandler(176): Closed tabletest,ooo,1377814517522.16d9fd46b6932e1be21e5e7f4dd79ac4. 2013-08-29 22:20:18,675 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] handler.CloseRegionHandler(125): Processing close of tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:20:18,675 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(950): Closing tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b.: disabling compactions & flushes 2013-08-29 22:20:18,675 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(972): Updates disabled for region tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:20:18,676 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1475): Started memstore flush for tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b., current region memstore size 576.7 K 2013-08-29 22:20:18,701 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/e0f77722c886c7dbde9efcde4f60c2c6/family/db79fdea786e49849d37581a77205063, entries=703, sequenceid=79, filesize=23.4 K 2013-08-29 22:20:18,702 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. in 428ms, sequenceid=79, compaction requested=false 2013-08-29 22:20:18,704 INFO [StoreCloserThread-tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:18,704 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1030): Closed tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:20:18,704 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] handler.CloseRegionHandler(176): Closed tabletest,ppp,1377814517528.e0f77722c886c7dbde9efcde4f60c2c6. 2013-08-29 22:20:18,704 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] handler.CloseRegionHandler(125): Processing close of tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:20:18,705 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(950): Closing tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9.: disabling compactions & flushes 2013-08-29 22:20:18,705 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(972): Updates disabled for region tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:20:18,705 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1475): Started memstore flush for tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9., current region memstore size 576.7 K 2013-08-29 22:20:18,757 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] master.SplitLogManager(357): error while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] installed = 1 but only 0 done 2013-08-29 22:20:18,758 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-3] executor.EventHandler(134): Caught throwable while processing event M_META_SERVER_SHUTDOWN java.io.IOException: failed log splitting for kiyo.gq1.ygridcore.net,51291,1377814509998, will retry at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:105) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.IOException: error or interrupted while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] Task = installed = 1 done = 0 error = 0 at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:362) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) ... 4 more 2013-08-29 22:20:18,758 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] handler.MetaServerShutdownHandler(59): Splitting META logs for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,759 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] zookeeper.ZKUtil(690): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2013-08-29 22:20:18,841 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] master.SplitLogManager(1159): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,842 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,57016,1377814510039 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:18,843 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] handler.MetaServerShutdownHandler(87): META has been assigned to otherwhere, skip assigning. 2013-08-29 22:20:18,846 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] master.SplitLogManager(1345): dead splitlog workers [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:20:18,849 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] master.SplitLogManager(326): Scheduling batch of logs to split 2013-08-29 22:20:18,849 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] master.SplitLogManager(328): started splitting 1 logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] 2013-08-29 22:20:18,849 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] master.SplitLogManager(1013): Previously orphan task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta is now being waited upon 2013-08-29 22:20:18,866 INFO [IPC Server handler 7 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:18,866 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741870_1046 size 23952 2013-08-29 22:20:18,909 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$CreateAsyncCallback(1491): found pre-existing znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:18,909 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(707): put up splitlog task at znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:18,910 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 10 2013-08-29 22:20:18,916 INFO [IPC Server handler 1 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:20:18,917 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741871_1047 size 23952 2013-08-29 22:20:18,921 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:18,922 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:19,000 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=80, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/11a9c621d13d5b11ed27a0104fdd0798/.tmp/4f08b123ed184557acbc94723b6c9523 2013-08-29 22:20:19,009 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] master.SplitLogManager(439): Stopped while waiting for log splits to be completed 2013-08-29 22:20:19,013 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/11a9c621d13d5b11ed27a0104fdd0798/.tmp/4f08b123ed184557acbc94723b6c9523 as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/11a9c621d13d5b11ed27a0104fdd0798/family/4f08b123ed184557acbc94723b6c9523 2013-08-29 22:20:19,045 INFO [M:0;kiyo:44745] master.ServerManager(447): Waiting on regionserver(s) to go down kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:19,057 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=82, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/80313bc36e51c8a392f5a074bc08d6e9/.tmp/bbba8da186f14a3bbf27795bed6d099f 2013-08-29 22:20:19,058 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=81, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/63449e4bed174f301e94011ae27a579b/.tmp/7d49eb2cd4374dc0988f718bf3dd58ea 2013-08-29 22:20:19,072 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/80313bc36e51c8a392f5a074bc08d6e9/.tmp/bbba8da186f14a3bbf27795bed6d099f as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/80313bc36e51c8a392f5a074bc08d6e9/family/bbba8da186f14a3bbf27795bed6d099f 2013-08-29 22:20:19,072 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/63449e4bed174f301e94011ae27a579b/.tmp/7d49eb2cd4374dc0988f718bf3dd58ea as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/63449e4bed174f301e94011ae27a579b/family/7d49eb2cd4374dc0988f718bf3dd58ea 2013-08-29 22:20:19,092 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] master.SplitLogManager(357): error while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] installed = 1 but only 0 done 2013-08-29 22:20:19,092 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-4] executor.EventHandler(134): Caught throwable while processing event M_META_SERVER_SHUTDOWN java.io.IOException: failed log splitting for kiyo.gq1.ygridcore.net,51291,1377814509998, will retry at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:105) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.IOException: error or interrupted while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] Task = installed = 1 done = 0 error = 0 at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:362) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) ... 4 more 2013-08-29 22:20:19,092 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] handler.MetaServerShutdownHandler(59): Splitting META logs for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,094 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] zookeeper.ZKUtil(690): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2013-08-29 22:20:19,101 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/11a9c621d13d5b11ed27a0104fdd0798/family/4f08b123ed184557acbc94723b6c9523, entries=703, sequenceid=80, filesize=23.4 K 2013-08-29 22:20:19,102 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. in 434ms, sequenceid=80, compaction requested=false 2013-08-29 22:20:19,104 INFO [StoreCloserThread-tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:19,105 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1030): Closed tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:20:19,105 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(176): Closed tabletest,ggg,1377814517482.11a9c621d13d5b11ed27a0104fdd0798. 2013-08-29 22:20:19,105 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(125): Processing close of tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:20:19,105 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(950): Closing tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a.: disabling compactions & flushes 2013-08-29 22:20:19,105 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(972): Updates disabled for region tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:20:19,105 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1475): Started memstore flush for tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a., current region memstore size 576.7 K 2013-08-29 22:20:19,129 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(1075): Waiting on 3 regions to close 2013-08-29 22:20:19,129 DEBUG [RS:1;kiyo:57016] regionserver.HRegionServer(1079): {63449e4bed174f301e94011ae27a579b=tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b., 80313bc36e51c8a392f5a074bc08d6e9=tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9., a9f08b5289c0817bc15b68dd39ca295a=tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a.} 2013-08-29 22:20:19,152 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/63449e4bed174f301e94011ae27a579b/family/7d49eb2cd4374dc0988f718bf3dd58ea, entries=703, sequenceid=81, filesize=23.4 K 2013-08-29 22:20:19,152 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. in 476ms, sequenceid=81, compaction requested=false 2013-08-29 22:20:19,154 INFO [StoreCloserThread-tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:19,155 INFO [RS_CLOSE_REGION-kiyo:57016-1] regionserver.HRegion(1030): Closed tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:20:19,155 DEBUG [RS_CLOSE_REGION-kiyo:57016-1] handler.CloseRegionHandler(176): Closed tabletest,qqq,1377814517533.63449e4bed174f301e94011ae27a579b. 2013-08-29 22:20:19,191 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(1159): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,192 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/80313bc36e51c8a392f5a074bc08d6e9/family/bbba8da186f14a3bbf27795bed6d099f, entries=703, sequenceid=82, filesize=23.4 K 2013-08-29 22:20:19,192 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,57016,1377814510039 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,193 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. in 488ms, sequenceid=82, compaction requested=false 2013-08-29 22:20:19,193 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] handler.MetaServerShutdownHandler(87): META has been assigned to otherwhere, skip assigning. 2013-08-29 22:20:19,195 INFO [StoreCloserThread-tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:19,195 INFO [RS_CLOSE_REGION-kiyo:57016-2] regionserver.HRegion(1030): Closed tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:20:19,195 DEBUG [RS_CLOSE_REGION-kiyo:57016-2] handler.CloseRegionHandler(176): Closed tabletest,rrr,1377814517539.80313bc36e51c8a392f5a074bc08d6e9. 2013-08-29 22:20:19,196 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(1345): dead splitlog workers [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:20:19,199 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(326): Scheduling batch of logs to split 2013-08-29 22:20:19,199 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(328): started splitting 1 logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] 2013-08-29 22:20:19,199 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(1013): Previously orphan task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta is now being waited upon 2013-08-29 22:20:19,231 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$CreateAsyncCallback(1491): found pre-existing znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:19,232 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(707): put up splitlog task at znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:19,233 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 10 2013-08-29 22:20:19,295 INFO [IPC Server handler 5 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:19,296 INFO [IPC Server handler 3 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741873_1049 size 23952 2013-08-29 22:20:19,332 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(439): Stopped while waiting for log splits to be completed 2013-08-29 22:20:19,358 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.DefaultStoreFlusher(88): Flushed, sequenceid=83, memsize=115.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/a9f08b5289c0817bc15b68dd39ca295a/.tmp/9586a57d1e514daba31ee323a3f668da 2013-08-29 22:20:19,369 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegionFileSystem(338): Committing store file hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/a9f08b5289c0817bc15b68dd39ca295a/.tmp/9586a57d1e514daba31ee323a3f668da as hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/a9f08b5289c0817bc15b68dd39ca295a/family/9586a57d1e514daba31ee323a3f668da 2013-08-29 22:20:19,452 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] master.SplitLogManager(357): error while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] installed = 1 but only 0 done 2013-08-29 22:20:19,452 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-0] executor.EventHandler(134): Caught throwable while processing event M_META_SERVER_SHUTDOWN java.io.IOException: failed log splitting for kiyo.gq1.ygridcore.net,51291,1377814509998, will retry at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:105) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.IOException: error or interrupted while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] Task = installed = 1 done = 0 error = 0 at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:362) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) ... 4 more 2013-08-29 22:20:19,452 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] handler.MetaServerShutdownHandler(59): Splitting META logs for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,453 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] zookeeper.ZKUtil(690): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2013-08-29 22:20:19,460 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HStore(766): Added hdfs://localhost:38532/user/hortonzy/hbase/data/default/tabletest/a9f08b5289c0817bc15b68dd39ca295a/family/9586a57d1e514daba31ee323a3f668da, entries=703, sequenceid=83, filesize=23.4 K 2013-08-29 22:20:19,461 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1622): Finished memstore flush of ~576.7 K/590520, currentsize=0/0 for region tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. in 356ms, sequenceid=83, compaction requested=false 2013-08-29 22:20:19,462 INFO [StoreCloserThread-tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a.-1] regionserver.HStore(668): Closed family 2013-08-29 22:20:19,462 INFO [RS_CLOSE_REGION-kiyo:57016-0] regionserver.HRegion(1030): Closed tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:20:19,462 DEBUG [RS_CLOSE_REGION-kiyo:57016-0] handler.CloseRegionHandler(176): Closed tabletest,,1377814517454.a9f08b5289c0817bc15b68dd39ca295a. 2013-08-29 22:20:19,522 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(1159): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,523 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,57016,1377814510039 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,524 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] handler.MetaServerShutdownHandler(87): META has been assigned to otherwhere, skip assigning. 2013-08-29 22:20:19,526 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(1345): dead splitlog workers [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:20:19,528 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(326): Scheduling batch of logs to split 2013-08-29 22:20:19,529 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(328): started splitting 1 logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] 2013-08-29 22:20:19,529 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(1013): Previously orphan task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta is now being waited upon 2013-08-29 22:20:19,530 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(934): stopping server kiyo.gq1.ygridcore.net,57016,1377814510039; all regions closed. 2013-08-29 22:20:19,530 INFO [RS_OPEN_META-kiyo:57016-0.logSyncer] wal.FSHLog$LogSyncer(976): RS_OPEN_META-kiyo:57016-0.logSyncer exiting 2013-08-29 22:20:19,530 DEBUG [RS:1;kiyo:57016] wal.FSHLog(811): Closing WAL writer in hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:19,538 INFO [IPC Server handler 1 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:20:19,538 INFO [IPC Server handler 9 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:43547|RBW], ReplicaUnderConstruction[127.0.0.1:55111|RBW]]} size 0 2013-08-29 22:20:19,582 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$CreateAsyncCallback(1491): found pre-existing znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:19,583 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(707): put up splitlog task at znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:19,583 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 10 2013-08-29 22:20:19,616 INFO [RS:1;kiyo:57016.logSyncer] wal.FSHLog$LogSyncer(976): RS:1;kiyo:57016.logSyncer exiting 2013-08-29 22:20:19,616 DEBUG [RS:1;kiyo:57016] wal.FSHLog(811): Closing WAL writer in hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:19,621 INFO [IPC Server handler 4 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:43547 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:55111|RBW], ReplicaUnderConstruction[127.0.0.1:43547|RBW]]} size 0 2013-08-29 22:20:19,621 INFO [IPC Server handler 8 on 38532] blockmanagement.BlockManager(2237): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55111 is added to blk_1073741861_1037 size 1522550 2013-08-29 22:20:19,683 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(439): Stopped while waiting for log splits to be completed 2013-08-29 22:20:19,874 DEBUG [RS:1;kiyo:57016] wal.FSHLog(771): Moved 2 WAL file(s) to /user/hortonzy/hbase/oldWALs 2013-08-29 22:20:19,874 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] master.SplitLogManager(357): error while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] installed = 1 but only 0 done 2013-08-29 22:20:19,875 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-1] executor.EventHandler(134): Caught throwable while processing event M_META_SERVER_SHUTDOWN java.io.IOException: failed log splitting for kiyo.gq1.ygridcore.net,51291,1377814509998, will retry at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:105) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.IOException: error or interrupted while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] Task = installed = 1 done = 0 error = 0 at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:362) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) ... 4 more 2013-08-29 22:20:19,875 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] handler.MetaServerShutdownHandler(59): Splitting META logs for kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,876 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] zookeeper.ZKUtil(690): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2013-08-29 22:20:19,965 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(1159): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,967 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.AssignmentManager(3112): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,57016,1377814510039 server being checked: kiyo.gq1.ygridcore.net,51291,1377814509998 2013-08-29 22:20:19,968 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] handler.MetaServerShutdownHandler(87): META has been assigned to otherwhere, skip assigning. 2013-08-29 22:20:19,970 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(1345): dead splitlog workers [kiyo.gq1.ygridcore.net,51291,1377814509998] 2013-08-29 22:20:19,973 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(326): Scheduling batch of logs to split 2013-08-29 22:20:19,973 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(328): started splitting 1 logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] 2013-08-29 22:20:19,973 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(1013): Previously orphan task /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta is now being waited upon 2013-08-29 22:20:20,005 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager$CreateAsyncCallback(1491): found pre-existing znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:20,006 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(707): put up splitlog task at znode /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta 2013-08-29 22:20:20,007 DEBUG [pool-1-thread-1-EventThread] master.SplitLogManager(749): task not yet acquired /hbase/splitWAL/WALs%2Fkiyo.gq1.ygridcore.net%2C51291%2C1377814509998-splitting%2Fkiyo.gq1.ygridcore.net%252C51291%252C1377814509998.1377814515397.meta ver = 10 2013-08-29 22:20:20,041 INFO [RS:1;kiyo:57016] regionserver.Leases(147): RS:1;kiyo:57016 closing leases 2013-08-29 22:20:20,041 INFO [RS:1;kiyo:57016] regionserver.Leases(150): RS:1;kiyo:57016 closed leases 2013-08-29 22:20:20,041 INFO [RS:1;kiyo:57016] regionserver.CompactSplitThread(357): Waiting for Split Thread to finish... 2013-08-29 22:20:20,042 INFO [RS:1;kiyo:57016] regionserver.CompactSplitThread(357): Waiting for Merge Thread to finish... 2013-08-29 22:20:20,042 INFO [RS:1;kiyo:57016] regionserver.CompactSplitThread(357): Waiting for Large Compaction Thread to finish... 2013-08-29 22:20:20,042 INFO [RS:1;kiyo:57016] regionserver.CompactSplitThread(357): Waiting for Small Compaction Thread to finish... 2013-08-29 22:20:20,047 INFO [M:0;kiyo:44745] master.ServerManager(447): Waiting on regionserver(s) to go down kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:20,074 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/kiyo.gq1.ygridcore.net,57016,1377814510039 2013-08-29 22:20:20,074 INFO [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(94): RegionServer ephemeral node deleted, processing expiration [kiyo.gq1.ygridcore.net,57016,1377814510039] 2013-08-29 22:20:20,075 INFO [pool-1-thread-1-EventThread] master.ServerManager(494): Cluster shutdown set; kiyo.gq1.ygridcore.net,57016,1377814510039 expired; onlineServers=0 2013-08-29 22:20:20,075 DEBUG [M:0;kiyo:44745] master.HMaster(1302): Stopping service threads 2013-08-29 22:20:20,075 INFO [pool-1-thread-1-EventThread] master.HMaster(2447): Cluster shutdown set; onlineServer=0 2013-08-29 22:20:20,076 DEBUG [pool-1-thread-1-EventThread] catalog.CatalogTracker(208): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@d2a7c1e 2013-08-29 22:20:20,076 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2013-08-29 22:20:20,076 INFO [M:0;kiyo:44745.oldLogCleaner] hbase.Chore(93): M:0;kiyo:44745.oldLogCleaner exiting 2013-08-29 22:20:20,076 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(443): Interrupted while waiting for log splits to be completed 2013-08-29 22:20:20,076 INFO [M:0;kiyo:44745.archivedHFileCleaner] hbase.Chore(93): M:0;kiyo:44745.archivedHFileCleaner exiting 2013-08-29 22:20:20,077 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] zookeeper.ZooKeeperWatcher(460): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received InterruptedException, doing nothing here java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1309) at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1466) at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getChildren(RecoverableZooKeeper.java:278) at org.apache.hadoop.hbase.zookeeper.ZKUtil.listChildrenNoWatch(ZKUtil.java:576) at org.apache.hadoop.hbase.master.SplitLogManager.removeRecoveringRegionsFromZK(SplitLogManager.java:507) at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:352) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:20:20,078 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] zookeeper.ZooKeeperWatcher(460): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received InterruptedException, doing nothing here java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1309) at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1466) at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getChildren(RecoverableZooKeeper.java:278) at org.apache.hadoop.hbase.zookeeper.ZKUtil.listChildrenNoWatch(ZKUtil.java:576) at org.apache.hadoop.hbase.master.SplitLogManager.removeRecoveringRegionsFromZK(SplitLogManager.java:524) at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:352) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) 2013-08-29 22:20:20,078 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] master.SplitLogManager(357): error while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] installed = 1 but only 0 done 2013-08-29 22:20:20,079 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] executor.ExecutorService(145): Cannot submit [MetaServerShutdownHandler-kiyo.gq1.ygridcore.net,44745,1377814506185-59] because the executor is missing. Is this process shutting down? 2013-08-29 22:20:20,079 ERROR [MASTER_META_SERVER_OPERATIONS-kiyo:44745-2] executor.EventHandler(134): Caught throwable while processing event M_META_SERVER_SHUTDOWN java.io.IOException: failed log splitting for kiyo.gq1.ygridcore.net,51291,1377814509998, will retry at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:105) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:131) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.IOException: error or interrupted while splitting logs in [hdfs://localhost:38532/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,51291,1377814509998-splitting] Task = installed = 1 done = 0 error = 0 at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:362) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:408) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:300) at org.apache.hadoop.hbase.master.MasterFileSystem.splitMetaLog(MasterFileSystem.java:291) at org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:99) ... 4 more 2013-08-29 22:20:20,097 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(963): stopping server kiyo.gq1.ygridcore.net,57016,1377814510039; zookeeper connection closed. 2013-08-29 22:20:20,097 INFO [RS:1;kiyo:57016] regionserver.HRegionServer(966): RS:1;kiyo:57016 exiting 2013-08-29 22:20:20,098 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@634e3372] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(192): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@634e3372 2013-08-29 22:20:20,098 INFO [pool-1-thread-1] util.JVMClusterUtil(313): Shutdown of 1 master(s) and 2 regionserver(s) complete 2013-08-29 22:20:20,098 INFO [pool-1-thread-1] client.HConnectionManager$HConnectionImplementation(2281): Closing master protocol: MasterAdminService 2013-08-29 22:20:20,099 INFO [pool-1-thread-1] client.HConnectionManager$HConnectionImplementation(2281): Closing master protocol: MasterMonitorService 2013-08-29 22:20:20,099 INFO [pool-1-thread-1] client.HConnectionManager$HConnectionImplementation(1926): Closing zookeeper sessionid=0x140cc24e86a000a 2013-08-29 22:20:20,139 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(312): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2013-08-29 22:20:20,165 INFO [pool-1-thread-1] client.HConnectionManager$HConnectionImplementation(1926): Closing zookeeper sessionid=0x140cc24e86a0007 2013-08-29 22:20:20,165 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(433): master:44745-0x140cc24e86a0001-0x140cc24e86a0001 Set watcher on znode that does not yet exist, /hbase/master 2013-08-29 22:20:20,207 INFO [pool-1-thread-1] client.HConnectionManager$HConnectionImplementation(1926): Closing zookeeper sessionid=0x140cc24e86a0008 2013-08-29 22:20:20,281 INFO [M:0;kiyo:44745] master.HMaster(627): HMaster main thread exiting 2013-08-29 22:20:20,284 INFO [pool-1-thread-1] zookeeper.MiniZooKeeperCluster(246): Shutdown MiniZK cluster with all ZK servers 2013-08-29 22:20:20,285 WARN [pool-1-thread-1] datanode.DirectoryScanner(371): DirectoryScanner: shutdown has been called 2013-08-29 22:20:20,291 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped SelectChannelConnector@localhost:0 2013-08-29 22:20:20,383 DEBUG [M:0;kiyo:44745-EventThread] zookeeper.ZooKeeperWatcher(312): hconnection-0x173f7175-0x140cc24e86a0004-0x140cc24e86a0004 Received ZooKeeper Event, type=None, state=Disconnected, path=null 2013-08-29 22:20:20,383 DEBUG [M:0;kiyo:44745-EventThread] zookeeper.ZooKeeperWatcher(394): hconnection-0x173f7175-0x140cc24e86a0004-0x140cc24e86a0004 Received Disconnected from ZooKeeper, ignoring 2013-08-29 22:20:20,395 WARN [DataNode: [file:/grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/dfscluster_eba912c1-7f3f-427e-b6d1-13dd8ca70577/dfs/data/data3,file:/grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/dfscluster_eba912c1-7f3f-427e-b6d1-13dd8ca70577/dfs/data/data4] heartbeating to localhost/127.0.0.1:38532] datanode.BPServiceActor(575): BPOfferService for Block pool BP-1217277682-68.142.244.61-1377814500385 (storage id DS-1793634515-68.142.244.61-55111-1377814504904) service to localhost/127.0.0.1:38532 interrupted 2013-08-29 22:20:20,395 WARN [DataNode: [file:/grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/dfscluster_eba912c1-7f3f-427e-b6d1-13dd8ca70577/dfs/data/data3,file:/grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/dfscluster_eba912c1-7f3f-427e-b6d1-13dd8ca70577/dfs/data/data4] heartbeating to localhost/127.0.0.1:38532] datanode.BPServiceActor(685): Ending block pool service for: Block pool BP-1217277682-68.142.244.61-1377814500385 (storage id DS-1793634515-68.142.244.61-55111-1377814504904) service to localhost/127.0.0.1:38532 2013-08-29 22:20:20,396 WARN [pool-1-thread-1] datanode.DirectoryScanner(371): DirectoryScanner: shutdown has been called 2013-08-29 22:20:20,400 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped SelectChannelConnector@localhost:0 2013-08-29 22:20:20,439 WARN [DataNode: [file:/grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/dfscluster_eba912c1-7f3f-427e-b6d1-13dd8ca70577/dfs/data/data1,file:/grid/0/dev/ty/trunk/hbase-server/target/test-data/f8a438d6-ac33-41f8-944c-345703fdb3cc/dfscluster_eba912c1-7f3f-427e-b6d1-13dd8ca70577/dfs/data/data2] heartbeating to localhost/127.0.0.1:38532] datanode.BPServiceActor(685): Ending block pool service for: Block pool BP-1217277682-68.142.244.61-1377814500385 (storage id DS-826806964-68.142.244.61-43547-1377814504956) service to localhost/127.0.0.1:38532 2013-08-29 22:20:20,553 WARN [org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor@4805e9f1] blockmanagement.DecommissionManager$Monitor(78): Monitor interrupted: java.lang.InterruptedException: sleep interrupted 2013-08-29 22:20:20,564 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped SelectChannelConnector@localhost:0 2013-08-29 22:20:20,693 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(947): Minicluster is down