- Thread LEAK? -, OpenFileDescriptor=154 (was 72) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=514 (was 404) - SystemLoadAverage LEAK? -, ProcessCount=460 (was 460), AvailableMemoryMB=4525 (was 4724), ConnectionCount=0 (was 0) 2014-02-05 19:28:01,593 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: coprocessor.TestRegionServerCoprocessorExceptionWithAbort#testExceptionFromCoprocessorDuringPut Thread=26, OpenFileDescriptor=154, MaxFileDescriptor=32768, SystemLoadAverage=514, ProcessCount=460, AvailableMemoryMB=4525, ConnectionCount=0 2014-02-05 19:28:01,594 INFO [Thread-204] hbase.HBaseTestingUtility(831): Starting up minicluster with 1 master(s) and 2 regionserver(s) and 2 datanode(s) 2014-02-05 19:28:01,595 INFO [Thread-204] hbase.HBaseTestingUtility(331): System.getProperty("hadoop.log.dir") already set to: /homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/hadoop_logs so I do NOT create it in target/test-data/fa5285e4-99ba-4fb1-bae8-36289abd5e1d 2014-02-05 19:28:01,595 INFO [Thread-204] hbase.HBaseTestingUtility(331): System.getProperty("hadoop.tmp.dir") already set to: /homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/hadoop_tmp so I do NOT create it in target/test-data/fa5285e4-99ba-4fb1-bae8-36289abd5e1d 2014-02-05 19:28:01,596 INFO [Thread-204] hbase.HBaseTestingUtility(618): Setting test.cache.data to /homes/hortonzy/98/hbase-server/target/test-data/fa5285e4-99ba-4fb1-bae8-36289abd5e1d/cache_data in system properties and HBase conf 2014-02-05 19:28:01,596 INFO [Thread-204] hbase.HBaseTestingUtility(618): Setting hadoop.tmp.dir to /homes/hortonzy/98/hbase-server/target/test-data/fa5285e4-99ba-4fb1-bae8-36289abd5e1d/hadoop_tmp in system properties and HBase conf 2014-02-05 19:28:01,596 INFO [Thread-204] hbase.HBaseTestingUtility(618): Setting hadoop.log.dir to /homes/hortonzy/98/hbase-server/target/test-data/fa5285e4-99ba-4fb1-bae8-36289abd5e1d/hadoop_logs in system properties and HBase conf 2014-02-05 19:28:01,596 INFO [Thread-204] hbase.HBaseTestingUtility(618): Setting mapred.local.dir to /homes/hortonzy/98/hbase-server/target/test-data/fa5285e4-99ba-4fb1-bae8-36289abd5e1d/mapred_local in system properties and HBase conf 2014-02-05 19:28:01,598 INFO [Thread-204] hbase.HBaseTestingUtility(618): Setting mapred.temp.dir to /homes/hortonzy/98/hbase-server/target/test-data/fa5285e4-99ba-4fb1-bae8-36289abd5e1d/mapred_temp in system properties and HBase conf 2014-02-05 19:28:01,598 INFO [Thread-204] hbase.HBaseTestingUtility(609): read short circuit is OFF 2014-02-05 19:28:01,598 DEBUG [Thread-204] fs.HFileSystem(214): The file system is not a DistributedFileSystem. Skipping on block location reordering 2014-02-05 19:28:03,637 INFO [Thread-204] log.Slf4jLog(67): jetty-6.1.26 2014-02-05 19:28:03,650 INFO [Thread-204] log.Slf4jLog(67): Extract jar:file:/homes/hortonzy/.m2/repository/org/apache/hadoop/hadoop-core/1.2.1/hadoop-core-1.2.1.jar!/webapps/hdfs to /tmp/Jetty_localhost_58065_hdfs____tvrity/webapp 2014-02-05 19:28:03,804 INFO [Thread-204] log.Slf4jLog(67): Started SelectChannelConnector@localhost:58065 Starting DataNode 0 with dfs.data.dir: /homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data1,/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data2 2014-02-05 19:28:04,276 INFO [Thread-204] log.Slf4jLog(67): jetty-6.1.26 2014-02-05 19:28:04,286 INFO [Thread-204] log.Slf4jLog(67): Extract jar:file:/homes/hortonzy/.m2/repository/org/apache/hadoop/hadoop-core/1.2.1/hadoop-core-1.2.1.jar!/webapps/datanode to /tmp/Jetty_localhost_54731_datanode____49x399/webapp 2014-02-05 19:28:04,440 INFO [Thread-204] log.Slf4jLog(67): Started SelectChannelConnector@localhost:54731 Starting DataNode 1 with dfs.data.dir: /homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data3,/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data4 2014-02-05 19:28:06,546 INFO [Thread-204] log.Slf4jLog(67): jetty-6.1.26 2014-02-05 19:28:06,554 INFO [Thread-204] log.Slf4jLog(67): Extract jar:file:/homes/hortonzy/.m2/repository/org/apache/hadoop/hadoop-core/1.2.1/hadoop-core-1.2.1.jar!/webapps/datanode to /tmp/Jetty_localhost_51377_datanode____9dp47y/webapp 2014-02-05 19:28:06,700 INFO [Thread-204] log.Slf4jLog(67): Started SelectChannelConnector@localhost:51377 Cluster is active 2014-02-05 19:28:06,863 INFO [Thread-204] zookeeper.MiniZooKeeperCluster(200): Started MiniZK Cluster and connect 1 ZK server on client port: 56427 2014-02-05 19:28:07,573 DEBUG [Thread-204] util.FSUtils(638): Created version file at hdfs://localhost:53087/user/hortonzy/hbase with version=8 2014-02-05 19:28:07,575 DEBUG [Thread-204] client.HConnectionManager(2812): master/kiyo.gq1.ygridcore.net/68.142.244.61:0 HConnection server-to-server retries=20 2014-02-05 19:28:07,578 INFO [Thread-204] master.HMaster(458): hbase.rootdir=hdfs://localhost:53087/user/hortonzy/hbase, hbase.cluster.distributed=false 2014-02-05 19:28:07,580 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=master:48976 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:07,664 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:07,666 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): master:48976-0x144038588cb0000 connected 2014-02-05 19:28:07,788 DEBUG [Thread-204] client.HConnectionManager(2812): regionserver/kiyo.gq1.ygridcore.net/68.142.244.61:0 HConnection server-to-server retries=20 2014-02-05 19:28:07,794 INFO [Thread-204] log.Slf4jLog(67): jetty-6.1.26 2014-02-05 19:28:07,810 INFO [Thread-204] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:52856 2014-02-05 19:28:07,826 DEBUG [Thread-204] client.HConnectionManager(2812): regionserver/kiyo.gq1.ygridcore.net/68.142.244.61:0 HConnection server-to-server retries=20 2014-02-05 19:28:07,832 INFO [Thread-204] log.Slf4jLog(67): jetty-6.1.26 2014-02-05 19:28:07,850 INFO [Thread-204] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:39229 2014-02-05 19:28:07,852 DEBUG [M:0;kiyo:48976] zookeeper.ZKUtil(430): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2014-02-05 19:28:07,853 DEBUG [M:0;kiyo:48976] zookeeper.ZKUtil(430): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-02-05 19:28:07,862 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2014-02-05 19:28:07,863 DEBUG [M:0;kiyo:48976] zookeeper.ZKUtil(428): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-02-05 19:28:07,864 WARN [M:0;kiyo:48976] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-02-05 19:28:07,864 INFO [M:0;kiyo:48976] master.ActiveMasterManager(170): Registered Active Master=kiyo.gq1.ygridcore.net,48976,1391628487578 2014-02-05 19:28:07,864 DEBUG [Thread-204-EventThread] zookeeper.ZKUtil(428): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-02-05 19:28:07,865 DEBUG [Thread-204-EventThread] master.ActiveMasterManager(119): A master is now available 2014-02-05 19:28:07,946 DEBUG [M:0;kiyo:48976] util.FSUtils(777): Created cluster ID file at hdfs://localhost:53087/user/hortonzy/hbase/hbase.id with ID: 1e3ea8f0-c861-4afb-bb6c-9413a121d807 2014-02-05 19:28:07,951 INFO [Thread-204] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:0;kiyo:56349 2014-02-05 19:28:07,952 INFO [Thread-204] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:1;kiyo:60181 2014-02-05 19:28:07,956 INFO [RS:1;kiyo:60181] zookeeper.RecoverableZooKeeper(120): Process identifier=regionserver:60181 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:07,956 INFO [M:0;kiyo:48976] master.MasterFileSystem(520): BOOTSTRAP: creating hbase:meta region 2014-02-05 19:28:07,957 INFO [RS:0;kiyo:56349] zookeeper.RecoverableZooKeeper(120): Process identifier=regionserver:56349 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:07,957 INFO [M:0;kiyo:48976] regionserver.HRegion(4180): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '10', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '8192', IN_MEMORY => 'false', BLOCKCACHE => 'false'} RootDir = hdfs://localhost:53087/user/hortonzy/hbase Table name == hbase:meta 2014-02-05 19:28:07,984 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:60181, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:07,986 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(387): regionserver:60181-0x144038588cb0001 connected 2014-02-05 19:28:08,000 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:08,001 DEBUG [RS:1;kiyo:60181] zookeeper.ZKUtil(428): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-02-05 19:28:08,001 DEBUG [RS:0;kiyo:56349] zookeeper.ZKUtil(428): regionserver:56349, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-02-05 19:28:08,002 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(387): regionserver:56349-0x144038588cb0002 connected 2014-02-05 19:28:08,002 DEBUG [RS:1;kiyo:60181] zookeeper.ZKUtil(430): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-02-05 19:28:08,003 DEBUG [RS:0;kiyo:56349] zookeeper.ZKUtil(430): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-02-05 19:28:08,181 INFO [M:0;kiyo:48976] wal.FSHLog(396): WAL/HLog configuration: blocksize=64 MB, rollsize=60.8 MB, enabled=true 2014-02-05 19:28:08,433 INFO [M:0;kiyo:48976] wal.FSHLog(574): New WAL /user/hortonzy/hbase/data/hbase/meta/1588230740/WALs/hlog.1391628488309 2014-02-05 19:28:08,436 DEBUG [M:0;kiyo:48976] regionserver.HRegion(563): Instantiated hbase:meta,,1.1588230740 2014-02-05 19:28:08,467 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:08,471 DEBUG [M:0;kiyo:48976] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/hbase/meta/1588230740 2014-02-05 19:28:08,474 INFO [M:0;kiyo:48976] regionserver.HRegion(664): Onlined 1588230740; next sequenceid=1 2014-02-05 19:28:08,474 DEBUG [M:0;kiyo:48976] regionserver.HRegion(1039): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2014-02-05 19:28:08,474 DEBUG [M:0;kiyo:48976] regionserver.HRegion(1061): Updates disabled for region hbase:meta,,1.1588230740 2014-02-05 19:28:08,475 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(740): Closed info 2014-02-05 19:28:08,475 INFO [M:0;kiyo:48976] regionserver.HRegion(1119): Closed hbase:meta,,1.1588230740 2014-02-05 19:28:08,475 DEBUG [M:0;kiyo:48976-WAL.AsyncNotifier] wal.FSHLog$AsyncNotifier(1332): M:0;kiyo:48976-WAL.AsyncNotifier interrupted while waiting for notification from AsyncSyncer thread 2014-02-05 19:28:08,475 INFO [M:0;kiyo:48976-WAL.AsyncNotifier] wal.FSHLog$AsyncNotifier(1337): M:0;kiyo:48976-WAL.AsyncNotifier exiting 2014-02-05 19:28:08,476 DEBUG [M:0;kiyo:48976-WAL.AsyncSyncer0] wal.FSHLog$AsyncSyncer(1278): M:0;kiyo:48976-WAL.AsyncSyncer0 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:08,476 INFO [M:0;kiyo:48976-WAL.AsyncSyncer0] wal.FSHLog$AsyncSyncer(1283): M:0;kiyo:48976-WAL.AsyncSyncer0 exiting 2014-02-05 19:28:08,476 DEBUG [M:0;kiyo:48976-WAL.AsyncSyncer1] wal.FSHLog$AsyncSyncer(1278): M:0;kiyo:48976-WAL.AsyncSyncer1 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:08,476 INFO [M:0;kiyo:48976-WAL.AsyncSyncer1] wal.FSHLog$AsyncSyncer(1283): M:0;kiyo:48976-WAL.AsyncSyncer1 exiting 2014-02-05 19:28:08,477 DEBUG [M:0;kiyo:48976-WAL.AsyncSyncer2] wal.FSHLog$AsyncSyncer(1278): M:0;kiyo:48976-WAL.AsyncSyncer2 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:08,477 INFO [M:0;kiyo:48976-WAL.AsyncSyncer2] wal.FSHLog$AsyncSyncer(1283): M:0;kiyo:48976-WAL.AsyncSyncer2 exiting 2014-02-05 19:28:08,477 DEBUG [M:0;kiyo:48976-WAL.AsyncSyncer3] wal.FSHLog$AsyncSyncer(1278): M:0;kiyo:48976-WAL.AsyncSyncer3 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:08,477 INFO [M:0;kiyo:48976-WAL.AsyncSyncer3] wal.FSHLog$AsyncSyncer(1283): M:0;kiyo:48976-WAL.AsyncSyncer3 exiting 2014-02-05 19:28:08,477 DEBUG [M:0;kiyo:48976-WAL.AsyncSyncer4] wal.FSHLog$AsyncSyncer(1278): M:0;kiyo:48976-WAL.AsyncSyncer4 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:08,478 INFO [M:0;kiyo:48976-WAL.AsyncSyncer4] wal.FSHLog$AsyncSyncer(1283): M:0;kiyo:48976-WAL.AsyncSyncer4 exiting 2014-02-05 19:28:08,478 DEBUG [M:0;kiyo:48976-WAL.AsyncWriter] wal.FSHLog$AsyncWriter(1153): M:0;kiyo:48976-WAL.AsyncWriter interrupted while waiting for newer writes added to local buffer 2014-02-05 19:28:08,478 INFO [M:0;kiyo:48976-WAL.AsyncWriter] wal.FSHLog$AsyncWriter(1158): M:0;kiyo:48976-WAL.AsyncWriter exiting 2014-02-05 19:28:08,478 DEBUG [M:0;kiyo:48976] wal.FSHLog(938): Closing WAL writer in hdfs://localhost:53087/user/hortonzy/hbase/data/hbase/meta/1588230740/WALs 2014-02-05 19:28:08,913 DEBUG [M:0;kiyo:48976] wal.FSHLog(882): Moved 1 WAL file(s) to /user/hortonzy/hbase/data/hbase/meta/1588230740/oldWALs 2014-02-05 19:28:09,481 DEBUG [M:0;kiyo:48976] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:53087/user/hortonzy/hbase/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2014-02-05 19:28:09,532 INFO [M:0;kiyo:48976] fs.HFileSystem(245): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-02-05 19:28:09,532 INFO [M:0;kiyo:48976] master.SplitLogManager(226): Timeout=120000, unassigned timeout=180000, distributedLogReplay=true 2014-02-05 19:28:09,533 INFO [M:0;kiyo:48976] master.SplitLogManager(1107): Found 0 orphan tasks and 0 rescan nodes 2014-02-05 19:28:09,550 INFO [M:0;kiyo:48976] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x77e0693f connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:09,565 DEBUG [M:0;kiyo:48976-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x77e0693f, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:09,567 DEBUG [M:0;kiyo:48976-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x77e0693f-0x144038588cb0003 connected 2014-02-05 19:28:09,568 DEBUG [M:0;kiyo:48976] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5cf5c616 2014-02-05 19:28:09,568 DEBUG [M:0;kiyo:48976] zookeeper.ZKUtil(430): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/meta-region-server 2014-02-05 19:28:09,569 DEBUG [M:0;kiyo:48976] zookeeper.ZKUtil(430): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2014-02-05 19:28:09,590 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-02-05 19:28:09,590 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-02-05 19:28:09,590 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-02-05 19:28:09,591 INFO [M:0;kiyo:48976] master.HMaster(698): Server active/primary master=kiyo.gq1.ygridcore.net,48976,1391628487578, sessionid=0x144038588cb0000, setting cluster-up flag (Was=false) 2014-02-05 19:28:09,595 INFO [RS:0;kiyo:56349] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x7516cf6c connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:09,633 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x7516cf6c, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:09,635 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x7516cf6c-0x144038588cb0004 connected 2014-02-05 19:28:09,691 DEBUG [RS:0;kiyo:56349] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@16970e60 2014-02-05 19:28:09,693 INFO [RS:1;kiyo:60181] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x1730cc36 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:09,708 DEBUG [RS:0;kiyo:56349] zookeeper.ZKUtil(430): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/meta-region-server 2014-02-05 19:28:09,727 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x1730cc36, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:09,728 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(745): ClusterId : 1e3ea8f0-c861-4afb-bb6c-9413a121d807 2014-02-05 19:28:09,728 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x1730cc36-0x144038588cb0005 connected 2014-02-05 19:28:09,735 INFO [M:0;kiyo:48976] procedure.ZKProcedureUtil(256): Clearing all procedure znodes: /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2014-02-05 19:28:09,735 DEBUG [RS:1;kiyo:60181] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@544216e 2014-02-05 19:28:09,744 INFO [RS:0;kiyo:56349] zookeeper.RecoverableZooKeeper(508): Node /hbase/online-snapshot/acquired already exists and this is not a retry 2014-02-05 19:28:09,744 DEBUG [RS:1;kiyo:60181] zookeeper.ZKUtil(430): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/meta-region-server 2014-02-05 19:28:09,745 DEBUG [M:0;kiyo:48976] procedure.ZKProcedureCoordinatorRpcs(195): Starting the controller for procedure member:kiyo.gq1.ygridcore.net,48976,1391628487578 2014-02-05 19:28:09,746 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(745): ClusterId : 1e3ea8f0-c861-4afb-bb6c-9413a121d807 2014-02-05 19:28:09,746 INFO [RS:0;kiyo:56349] regionserver.MemStoreFlusher(119): globalMemStoreLimit=675.6m, globalMemStoreLimitLowMark=641.8m, maxHeap=1.6g 2014-02-05 19:28:09,746 INFO [RS:0;kiyo:56349] regionserver.HRegionServer$CompactionChecker(1376): CompactionChecker runs every 1sec 2014-02-05 19:28:09,747 DEBUG [M:0;kiyo:48976] executor.ExecutorService(99): Starting executor service name=MASTER_OPEN_REGION-kiyo:48976, corePoolSize=5, maxPoolSize=5 2014-02-05 19:28:09,747 DEBUG [M:0;kiyo:48976] executor.ExecutorService(99): Starting executor service name=MASTER_CLOSE_REGION-kiyo:48976, corePoolSize=5, maxPoolSize=5 2014-02-05 19:28:09,747 DEBUG [M:0;kiyo:48976] executor.ExecutorService(99): Starting executor service name=MASTER_SERVER_OPERATIONS-kiyo:48976, corePoolSize=5, maxPoolSize=5 2014-02-05 19:28:09,747 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(1988): reportForDuty to master=kiyo.gq1.ygridcore.net,48976,1391628487578 with port=56349, startcode=1391628487792 2014-02-05 19:28:09,747 DEBUG [M:0;kiyo:48976] executor.ExecutorService(99): Starting executor service name=MASTER_META_SERVER_OPERATIONS-kiyo:48976, corePoolSize=5, maxPoolSize=5 2014-02-05 19:28:09,748 DEBUG [M:0;kiyo:48976] executor.ExecutorService(99): Starting executor service name=M_LOG_REPLAY_OPS-kiyo:48976, corePoolSize=10, maxPoolSize=10 2014-02-05 19:28:09,748 DEBUG [M:0;kiyo:48976] executor.ExecutorService(99): Starting executor service name=MASTER_TABLE_OPERATIONS-kiyo:48976, corePoolSize=1, maxPoolSize=1 2014-02-05 19:28:09,749 DEBUG [M:0;kiyo:48976] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2014-02-05 19:28:09,750 DEBUG [RS:0;kiyo:56349] regionserver.HRegionServer(2004): Master is not running yet 2014-02-05 19:28:09,750 WARN [RS:0;kiyo:56349] regionserver.HRegionServer(841): reportForDuty failed; sleeping and then retrying. 2014-02-05 19:28:09,751 INFO [M:0;kiyo:48976] zookeeper.RecoverableZooKeeper(120): Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:09,760 INFO [RS:1;kiyo:60181] zookeeper.RecoverableZooKeeper(508): Node /hbase/online-snapshot/acquired already exists and this is not a retry 2014-02-05 19:28:09,768 DEBUG [M:0;kiyo:48976-EventThread] zookeeper.ZooKeeperWatcher(310): replicationLogCleaner, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:09,770 DEBUG [M:0;kiyo:48976-EventThread] zookeeper.ZooKeeperWatcher(387): replicationLogCleaner-0x144038588cb0006 connected 2014-02-05 19:28:09,779 INFO [RS:1;kiyo:60181] regionserver.MemStoreFlusher(119): globalMemStoreLimit=675.6m, globalMemStoreLimitLowMark=641.8m, maxHeap=1.6g 2014-02-05 19:28:09,779 INFO [RS:1;kiyo:60181] regionserver.HRegionServer$CompactionChecker(1376): CompactionChecker runs every 1sec 2014-02-05 19:28:09,781 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(1988): reportForDuty to master=kiyo.gq1.ygridcore.net,48976,1391628487578 with port=60181, startcode=1391628487831 2014-02-05 19:28:09,784 DEBUG [RS:1;kiyo:60181] regionserver.HRegionServer(2004): Master is not running yet 2014-02-05 19:28:09,784 WARN [RS:1;kiyo:60181] regionserver.HRegionServer(841): reportForDuty failed; sleeping and then retrying. 2014-02-05 19:28:09,798 DEBUG [M:0;kiyo:48976] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2014-02-05 19:28:09,799 DEBUG [M:0;kiyo:48976] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotLogCleaner 2014-02-05 19:28:09,800 DEBUG [M:0;kiyo:48976] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2014-02-05 19:28:09,800 DEBUG [M:0;kiyo:48976] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2014-02-05 19:28:09,801 DEBUG [M:0;kiyo:48976] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2014-02-05 19:28:09,801 INFO [M:0;kiyo:48976] master.ServerManager(830): Waiting for region servers count to settle; currently checked in 0, slept for 0 ms, expecting minimum of 2, maximum of 2, timeout of 4500 ms, interval of 1500 ms. 2014-02-05 19:28:10,751 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(1988): reportForDuty to master=kiyo.gq1.ygridcore.net,48976,1391628487578 with port=56349, startcode=1391628487792 2014-02-05 19:28:10,752 INFO [FifoRpcScheduler.handler5-thread-3] master.ServerManager(374): Registering server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:10,753 DEBUG [RS:0;kiyo:56349] regionserver.HRegionServer(1215): Config from master: hbase.rootdir=hdfs://localhost:53087/user/hortonzy/hbase 2014-02-05 19:28:10,753 DEBUG [RS:0;kiyo:56349] regionserver.HRegionServer(1215): Config from master: fs.default.name=hdfs://localhost:53087 2014-02-05 19:28:10,755 INFO [M:0;kiyo:48976] master.ServerManager(830): Waiting for region servers count to settle; currently checked in 1, slept for 954 ms, expecting minimum of 2, maximum of 2, timeout of 4500 ms, interval of 1500 ms. 2014-02-05 19:28:10,785 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(1988): reportForDuty to master=kiyo.gq1.ygridcore.net,48976,1391628487578 with port=60181, startcode=1391628487831 2014-02-05 19:28:10,786 INFO [FifoRpcScheduler.handler5-thread-4] master.ServerManager(374): Registering server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:10,788 DEBUG [RS:1;kiyo:60181] regionserver.HRegionServer(1215): Config from master: hbase.rootdir=hdfs://localhost:53087/user/hortonzy/hbase 2014-02-05 19:28:10,788 DEBUG [RS:1;kiyo:60181] regionserver.HRegionServer(1215): Config from master: fs.default.name=hdfs://localhost:53087 2014-02-05 19:28:10,805 INFO [M:0;kiyo:48976] master.ServerManager(847): Finished waiting for region servers count to settle; checked in 2, slept for 1004 ms, expecting minimum of 2, maximum of 2, master is running. 2014-02-05 19:28:10,822 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-02-05 19:28:10,850 DEBUG [RS:0;kiyo:56349] zookeeper.ZKUtil(428): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:10,851 DEBUG [RS:1;kiyo:60181] zookeeper.ZKUtil(428): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:10,851 WARN [RS:0;kiyo:56349] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-02-05 19:28:10,851 WARN [RS:1;kiyo:60181] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-02-05 19:28:10,851 DEBUG [Thread-204-EventThread] zookeeper.ZKUtil(428): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:10,852 DEBUG [Thread-204-EventThread] zookeeper.ZKUtil(428): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:10,855 DEBUG [Thread-204-EventThread] zookeeper.RegionServerTracker(91): RS node: /hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 data: PBUF� 2014-02-05 19:28:10,855 DEBUG [Thread-204-EventThread] zookeeper.RegionServerTracker(91): RS node: /hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 data: PBUF�� 2014-02-05 19:28:10,856 INFO [RS:0;kiyo:56349] fs.HFileSystem(245): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-02-05 19:28:10,856 INFO [RS:1;kiyo:60181] fs.HFileSystem(245): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-02-05 19:28:10,858 DEBUG [RS:1;kiyo:60181] regionserver.HRegionServer(1473): logdir=hdfs://localhost:53087/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:10,858 DEBUG [RS:0;kiyo:56349] regionserver.HRegionServer(1473): logdir=hdfs://localhost:53087/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:10,920 DEBUG [RS:1;kiyo:60181] regionserver.Replication(138): ReplicationStatisticsThread 300 2014-02-05 19:28:10,921 INFO [RS:1;kiyo:60181] wal.FSHLog(396): WAL/HLog configuration: blocksize=64 MB, rollsize=60.8 MB, enabled=true 2014-02-05 19:28:10,921 DEBUG [RS:0;kiyo:56349] regionserver.Replication(138): ReplicationStatisticsThread 300 2014-02-05 19:28:10,922 INFO [RS:0;kiyo:56349] wal.FSHLog(396): WAL/HLog configuration: blocksize=64 MB, rollsize=60.8 MB, enabled=true 2014-02-05 19:28:11,148 INFO [RS:1;kiyo:60181] wal.FSHLog(574): New WAL /user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,60181,1391628487831/kiyo.gq1.ygridcore.net%2C60181%2C1391628487831.1391628490984 2014-02-05 19:28:11,150 INFO [RS:1;kiyo:60181] regionserver.MetricsRegionServerWrapperImpl(89): Computing regionserver metrics every 5000 milliseconds 2014-02-05 19:28:11,150 DEBUG [RS:1;kiyo:60181] executor.ExecutorService(99): Starting executor service name=RS_OPEN_REGION-kiyo:60181, corePoolSize=3, maxPoolSize=3 2014-02-05 19:28:11,151 DEBUG [RS:1;kiyo:60181] executor.ExecutorService(99): Starting executor service name=RS_OPEN_META-kiyo:60181, corePoolSize=1, maxPoolSize=1 2014-02-05 19:28:11,151 DEBUG [RS:1;kiyo:60181] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_REGION-kiyo:60181, corePoolSize=3, maxPoolSize=3 2014-02-05 19:28:11,151 DEBUG [RS:1;kiyo:60181] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_META-kiyo:60181, corePoolSize=1, maxPoolSize=1 2014-02-05 19:28:11,152 DEBUG [RS:1;kiyo:60181] executor.ExecutorService(99): Starting executor service name=RS_LOG_REPLAY_OPS-kiyo:60181, corePoolSize=2, maxPoolSize=2 2014-02-05 19:28:11,155 DEBUG [RS:1;kiyo:60181] zookeeper.ZKUtil(428): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:11,156 DEBUG [RS:1;kiyo:60181] zookeeper.ZKUtil(428): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:11,157 INFO [RS:1;kiyo:60181] regionserver.ReplicationSourceManager(203): Current list of replicators: [kiyo.gq1.ygridcore.net,56349,1391628487792, kiyo.gq1.ygridcore.net,60181,1391628487831] other RSs: [kiyo.gq1.ygridcore.net,56349,1391628487792, kiyo.gq1.ygridcore.net,60181,1391628487831] 2014-02-05 19:28:11,180 INFO [RS:1;kiyo:60181] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x73c233e4 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:11,181 INFO [RS:0;kiyo:56349] wal.FSHLog(574): New WAL /user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,56349,1391628487792/kiyo.gq1.ygridcore.net%2C56349%2C1391628487792.1391628491036 2014-02-05 19:28:11,183 INFO [RS:0;kiyo:56349] regionserver.MetricsRegionServerWrapperImpl(89): Computing regionserver metrics every 5000 milliseconds 2014-02-05 19:28:11,184 DEBUG [RS:0;kiyo:56349] executor.ExecutorService(99): Starting executor service name=RS_OPEN_REGION-kiyo:56349, corePoolSize=3, maxPoolSize=3 2014-02-05 19:28:11,184 DEBUG [RS:0;kiyo:56349] executor.ExecutorService(99): Starting executor service name=RS_OPEN_META-kiyo:56349, corePoolSize=1, maxPoolSize=1 2014-02-05 19:28:11,184 DEBUG [RS:0;kiyo:56349] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_REGION-kiyo:56349, corePoolSize=3, maxPoolSize=3 2014-02-05 19:28:11,184 DEBUG [RS:0;kiyo:56349] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_META-kiyo:56349, corePoolSize=1, maxPoolSize=1 2014-02-05 19:28:11,185 DEBUG [RS:0;kiyo:56349] executor.ExecutorService(99): Starting executor service name=RS_LOG_REPLAY_OPS-kiyo:56349, corePoolSize=2, maxPoolSize=2 2014-02-05 19:28:11,206 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x73c233e4, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:11,208 DEBUG [RS:0;kiyo:56349] zookeeper.ZKUtil(428): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:11,208 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x73c233e4-0x144038588cb0007 connected 2014-02-05 19:28:11,211 DEBUG [RS:0;kiyo:56349] zookeeper.ZKUtil(428): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:11,211 INFO [RS:0;kiyo:56349] regionserver.ReplicationSourceManager(203): Current list of replicators: [kiyo.gq1.ygridcore.net,56349,1391628487792, kiyo.gq1.ygridcore.net,60181,1391628487831] other RSs: [kiyo.gq1.ygridcore.net,56349,1391628487792, kiyo.gq1.ygridcore.net,60181,1391628487831] 2014-02-05 19:28:11,227 INFO [RS:0;kiyo:56349] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x16d6b06f connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:11,228 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(1251): Serving as kiyo.gq1.ygridcore.net,60181,1391628487831, RpcServer on kiyo.gq1.ygridcore.net/68.142.244.61:60181, sessionid=0x144038588cb0001 2014-02-05 19:28:11,228 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,60181,1391628487831] regionserver.SplitLogWorker(175): SplitLogWorker kiyo.gq1.ygridcore.net,60181,1391628487831 starting 2014-02-05 19:28:11,228 DEBUG [RS:1;kiyo:60181] snapshot.RegionServerSnapshotManager(141): Start Snapshot Manager kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:11,229 DEBUG [RS:1;kiyo:60181] procedure.ZKProcedureMemberRpcs(337): Starting procedure member 'kiyo.gq1.ygridcore.net,60181,1391628487831' 2014-02-05 19:28:11,229 DEBUG [RS:1;kiyo:60181] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-02-05 19:28:11,231 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,60181,1391628487831] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x297e9172 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:11,248 DEBUG [RS:1;kiyo:60181] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-02-05 19:28:11,248 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x16d6b06f, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:11,250 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x16d6b06f-0x144038588cb0008 connected 2014-02-05 19:28:11,267 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,60181,1391628487831-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x297e9172, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:11,268 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,60181,1391628487831-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x297e9172-0x144038588cb0009 connected 2014-02-05 19:28:11,289 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(1251): Serving as kiyo.gq1.ygridcore.net,56349,1391628487792, RpcServer on kiyo.gq1.ygridcore.net/68.142.244.61:56349, sessionid=0x144038588cb0002 2014-02-05 19:28:11,289 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,56349,1391628487792] regionserver.SplitLogWorker(175): SplitLogWorker kiyo.gq1.ygridcore.net,56349,1391628487792 starting 2014-02-05 19:28:11,289 DEBUG [RS:0;kiyo:56349] snapshot.RegionServerSnapshotManager(141): Start Snapshot Manager kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:11,290 DEBUG [RS:0;kiyo:56349] procedure.ZKProcedureMemberRpcs(337): Starting procedure member 'kiyo.gq1.ygridcore.net,56349,1391628487792' 2014-02-05 19:28:11,290 DEBUG [RS:0;kiyo:56349] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-02-05 19:28:11,291 DEBUG [RS:0;kiyo:56349] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-02-05 19:28:11,294 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,56349,1391628487792] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x45bdf0c connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:11,316 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,56349,1391628487792-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x45bdf0c, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:11,318 DEBUG [SplitLogWorker-kiyo.gq1.ygridcore.net,56349,1391628487792-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x45bdf0c-0x144038588cb000a connected 2014-02-05 19:28:11,874 INFO [M:0;kiyo:48976] zookeeper.MetaRegionTracker(164): Unsetting hbase:meta region location in ZooKeeper 2014-02-05 19:28:12,038 WARN [M:0;kiyo:48976] zookeeper.RecoverableZooKeeper(166): Node /hbase/meta-region-server already deleted, retry=false 2014-02-05 19:28:12,039 DEBUG [M:0;kiyo:48976] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for hbase:meta,,1.1588230740; generated random plan=hri=hbase:meta,,1.1588230740, src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=false 2014-02-05 19:28:12,039 DEBUG [M:0;kiyo:48976] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 1588230740 with OFFLINE state 2014-02-05 19:28:12,057 DEBUG [M:0;kiyo:48976] master.AssignmentManager(1897): Setting table hbase:meta to ENABLED state. 2014-02-05 19:28:12,116 INFO [M:0;kiyo:48976] master.AssignmentManager(1912): Assigning hbase:meta,,1.1588230740 to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:12,116 INFO [M:0;kiyo:48976] master.RegionStates(316): Transitioned {1588230740 state=OFFLINE, ts=1391628492039, server=null} to {1588230740 state=PENDING_OPEN, ts=1391628492116, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:12,116 DEBUG [M:0;kiyo:48976] master.ServerManager(765): New admin connection to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:12,119 INFO [Priority.RpcServer.handler=0,port=56349] regionserver.HRegionServer(3594): Open hbase:meta,,1.1588230740 2014-02-05 19:28:12,121 DEBUG [RS_OPEN_META-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:12,121 INFO [M:0;kiyo:48976] master.ServerManager(562): AssignmentManager hasn't finished failover cleanup; waiting 2014-02-05 19:28:12,235 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2014-02-05 19:28:12,235 DEBUG [RS_OPEN_META-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:12,236 DEBUG [RS_OPEN_META-kiyo:56349-0] regionserver.HRegionServer(1490): logdir=hdfs://localhost:53087/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:12,237 INFO [RS_OPEN_META-kiyo:56349-0] wal.FSHLog(396): WAL/HLog configuration: blocksize=64 MB, rollsize=60.8 MB, enabled=true 2014-02-05 19:28:12,238 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=1588230740, current_state={1588230740 state=PENDING_OPEN, ts=1391628492116, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:12,239 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(316): Transitioned {1588230740 state=PENDING_OPEN, ts=1391628492116, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {1588230740 state=OPENING, ts=1391628492239, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:12,370 INFO [RS_OPEN_META-kiyo:56349-0] wal.FSHLog(574): New WAL /user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,56349,1391628487792/kiyo.gq1.ygridcore.net%2C56349%2C1391628487792.1391628492240.meta 2014-02-05 19:28:12,374 DEBUG [RS_OPEN_META-kiyo:56349-0] regionserver.HRegion(4366): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:12,375 INFO [RS_OPEN_META-kiyo:56349-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:12,377 DEBUG [RS_OPEN_META-kiyo:56349-0] coprocessor.CoprocessorHost(188): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2014-02-05 19:28:12,377 DEBUG [RS_OPEN_META-kiyo:56349-0] regionserver.HRegion(5421): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2014-02-05 19:28:12,377 INFO [RS_OPEN_META-kiyo:56349-0] regionserver.RegionCoprocessorHost(209): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2014-02-05 19:28:12,377 DEBUG [RS_OPEN_META-kiyo:56349-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table meta 1588230740 2014-02-05 19:28:12,378 DEBUG [RS_OPEN_META-kiyo:56349-0] regionserver.HRegion(563): Instantiated hbase:meta,,1.1588230740 2014-02-05 19:28:12,384 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:12,388 DEBUG [RS_OPEN_META-kiyo:56349-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/hbase/meta/1588230740 2014-02-05 19:28:12,390 INFO [RS_OPEN_META-kiyo:56349-0] regionserver.HRegion(664): Onlined 1588230740; next sequenceid=1 2014-02-05 19:28:12,390 DEBUG [RS_OPEN_META-kiyo:56349-0] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 1588230740 2014-02-05 19:28:12,392 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1748): Post open deploy tasks for region=hbase:meta,,1.1588230740 2014-02-05 19:28:12,392 INFO [PostOpenDeployTasks:1588230740] zookeeper.MetaRegionTracker(123): Setting hbase:meta region location in ZooKeeper as kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:12,415 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2014-02-05 19:28:12,415 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2014-02-05 19:28:12,415 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2014-02-05 19:28:12,418 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1773): Finished post open deploy task for hbase:meta,,1.1588230740 2014-02-05 19:28:12,418 DEBUG [RS_OPEN_META-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:12,439 DEBUG [RS_OPEN_META-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:12,439 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2014-02-05 19:28:12,439 DEBUG [RS_OPEN_META-kiyo:56349-0] handler.OpenRegionHandler(379): Transitioned 1588230740 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:12,439 DEBUG [RS_OPEN_META-kiyo:56349-0] handler.OpenRegionHandler(179): Opened hbase:meta,,1.1588230740 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:12,441 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=1588230740, current_state={1588230740 state=OPENING, ts=1391628492239, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:12,441 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(316): Transitioned {1588230740 state=OPENING, ts=1391628492239, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {1588230740 state=OPEN, ts=1391628492441, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:12,441 INFO [AM.ZK.Worker-pool15-t2] handler.OpenedRegionHandler(147): Handling OPENED of 1588230740 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:12,463 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2014-02-05 19:28:12,463 DEBUG [AM.ZK.Worker-pool15-t2] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 1588230740 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:12,464 DEBUG [AM.ZK.Worker-pool15-t3] master.AssignmentManager$4(1175): Znode hbase:meta,,1.1588230740 deleted, state: {1588230740 state=OPEN, ts=1391628492441, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:12,465 INFO [AM.ZK.Worker-pool15-t3] master.RegionStates(377): Onlined 1588230740 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:12,467 INFO [M:0;kiyo:48976] master.HMaster(1041): hbase:meta assigned=1, rit=false, location=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:12,476 INFO [M:0;kiyo:48976] catalog.MetaMigrationConvertingToPB(166): hbase:meta doesn't have any entries to update. 2014-02-05 19:28:12,476 INFO [M:0;kiyo:48976] catalog.MetaMigrationConvertingToPB(132): META already up-to date with PB serialization 2014-02-05 19:28:12,489 INFO [M:0;kiyo:48976] master.AssignmentManager(510): Clean cluster startup. Assigning userregions 2014-02-05 19:28:12,489 DEBUG [M:0;kiyo:48976] zookeeper.ZKAssign(498): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleting any existing unassigned nodes 2014-02-05 19:28:12,494 INFO [M:0;kiyo:48976] master.SnapshotOfRegionAssignmentFromMeta(95): Start to scan the hbase:meta for the current region assignment snappshot 2014-02-05 19:28:12,501 INFO [M:0;kiyo:48976] master.SnapshotOfRegionAssignmentFromMeta(138): Finished to scan the hbase:meta for the current region assignmentsnapshot 2014-02-05 19:28:12,516 INFO [M:0;kiyo:48976] master.TableNamespaceManager(85): Namespace table not found. Creating... 2014-02-05 19:28:12,794 DEBUG [M:0;kiyo:48976] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/hbase:namespace/write-master:489760000000000 2014-02-05 19:28:12,863 INFO [MASTER_TABLE_OPERATIONS-kiyo:48976-0] handler.CreateTableHandler(148): Create table hbase:namespace 2014-02-05 19:28:13,705 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:53087/user/hortonzy/hbase/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2014-02-05 19:28:13,707 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(4180): creating HRegion hbase:namespace HTD == 'hbase:namespace', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '10', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '8192', IN_MEMORY => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:53087/user/hortonzy/hbase/.tmp Table name == hbase:namespace 2014-02-05 19:28:13,862 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(563): Instantiated hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:13,862 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1039): Closing hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7.: disabling compactions & flushes 2014-02-05 19:28:13,862 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1061): Updates disabled for region hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:13,862 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1119): Closed hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:13,956 INFO [MASTER_TABLE_OPERATIONS-kiyo:48976-0] catalog.MetaEditor(278): Added 1 2014-02-05 19:28:13,957 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1453): Assigning 1 region(s) to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:13,957 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node e513fb0093c1f4c7b2598886cb3542b7 with OFFLINE state 2014-02-05 19:28:13,989 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:13,989 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={e513fb0093c1f4c7b2598886cb3542b7 state=OFFLINE, ts=1391628493957, server=null}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:13,990 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={e513fb0093c1f4c7b2598886cb3542b7 state=OFFLINE, ts=1391628493957, server=null}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:13,994 INFO [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1504): kiyo.gq1.ygridcore.net,56349,1391628487792 unassigned znodes=1 of total=1 2014-02-05 19:28:13,994 INFO [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {e513fb0093c1f4c7b2598886cb3542b7 state=OFFLINE, ts=1391628493957, server=null} to {e513fb0093c1f4c7b2598886cb3542b7 state=PENDING_OPEN, ts=1391628493994, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:13,996 INFO [Priority.RpcServer.handler=8,port=56349] regionserver.HRegionServer(3594): Open hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:14,004 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning e513fb0093c1f4c7b2598886cb3542b7 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:14,004 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1628): Bulk assigning done for kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:14,063 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e513fb0093c1f4c7b2598886cb3542b7 2014-02-05 19:28:14,064 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node e513fb0093c1f4c7b2598886cb3542b7 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:14,066 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(4366): Opening region: {ENCODED => e513fb0093c1f4c7b2598886cb3542b7, NAME => 'hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7.', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:14,067 INFO [RS_OPEN_REGION-kiyo:56349-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:14,067 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table namespace e513fb0093c1f4c7b2598886cb3542b7 2014-02-05 19:28:14,068 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(563): Instantiated hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:14,104 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/hbase:namespace/write-master:489760000000000 2014-02-05 19:28:14,105 DEBUG [AM.ZK.Worker-pool15-t5] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=e513fb0093c1f4c7b2598886cb3542b7, current_state={e513fb0093c1f4c7b2598886cb3542b7 state=PENDING_OPEN, ts=1391628493994, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:14,105 INFO [AM.ZK.Worker-pool15-t5] master.RegionStates(316): Transitioned {e513fb0093c1f4c7b2598886cb3542b7 state=PENDING_OPEN, ts=1391628493994, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {e513fb0093c1f4c7b2598886cb3542b7 state=OPENING, ts=1391628494105, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:14,129 INFO [StoreOpener-e513fb0093c1f4c7b2598886cb3542b7-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:14,133 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/hbase/namespace/e513fb0093c1f4c7b2598886cb3542b7 2014-02-05 19:28:14,135 INFO [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(664): Onlined e513fb0093c1f4c7b2598886cb3542b7; next sequenceid=1 2014-02-05 19:28:14,136 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node e513fb0093c1f4c7b2598886cb3542b7 2014-02-05 19:28:14,138 INFO [PostOpenDeployTasks:e513fb0093c1f4c7b2598886cb3542b7] regionserver.HRegionServer(1748): Post open deploy tasks for region=hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:14,149 INFO [PostOpenDeployTasks:e513fb0093c1f4c7b2598886cb3542b7] catalog.MetaEditor(464): Updated row hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:14,149 INFO [PostOpenDeployTasks:e513fb0093c1f4c7b2598886cb3542b7] regionserver.HRegionServer(1773): Finished post open deploy task for hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:14,150 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning e513fb0093c1f4c7b2598886cb3542b7 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:14,171 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node e513fb0093c1f4c7b2598886cb3542b7 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:14,171 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/e513fb0093c1f4c7b2598886cb3542b7 2014-02-05 19:28:14,171 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(379): Transitioned e513fb0093c1f4c7b2598886cb3542b7 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:14,171 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(179): Opened hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:14,173 DEBUG [AM.ZK.Worker-pool15-t6] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=e513fb0093c1f4c7b2598886cb3542b7, current_state={e513fb0093c1f4c7b2598886cb3542b7 state=OPENING, ts=1391628494105, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:14,173 INFO [AM.ZK.Worker-pool15-t6] master.RegionStates(316): Transitioned {e513fb0093c1f4c7b2598886cb3542b7 state=OPENING, ts=1391628494105, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {e513fb0093c1f4c7b2598886cb3542b7 state=OPEN, ts=1391628494173, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:14,173 DEBUG [AM.ZK.Worker-pool15-t6] handler.OpenedRegionHandler(149): Handling OPENED of e513fb0093c1f4c7b2598886cb3542b7 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:14,189 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/e513fb0093c1f4c7b2598886cb3542b7 2014-02-05 19:28:14,190 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:14,190 DEBUG [AM.ZK.Worker-pool15-t6] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node e513fb0093c1f4c7b2598886cb3542b7 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:14,191 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager$4(1175): Znode hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. deleted, state: {e513fb0093c1f4c7b2598886cb3542b7 state=OPEN, ts=1391628494173, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:14,191 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(377): Onlined e513fb0093c1f4c7b2598886cb3542b7 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:14,278 DEBUG [M:0;kiyo:48976] client.ClientSmallScanner(136): Finished with small scan at {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:14,281 DEBUG [M:0;kiyo:48976] zookeeper.ZKUtil(430): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2014-02-05 19:28:14,297 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2014-02-05 19:28:14,364 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2014-02-05 19:28:14,373 DEBUG [Thread-204-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node default with data: \x0A\x07default 2014-02-05 19:28:14,517 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2014-02-05 19:28:14,664 DEBUG [Thread-204-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node default with data: \x0A\x07default 2014-02-05 19:28:14,665 DEBUG [Thread-204-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node hbase with data: \x0A\x05hbase 2014-02-05 19:28:14,695 INFO [M:0;kiyo:48976] zookeeper.RecoverableZooKeeper(508): Node /hbase/namespace/default already exists and this is not a retry 2014-02-05 19:28:14,728 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2014-02-05 19:28:14,753 INFO [M:0;kiyo:48976] zookeeper.RecoverableZooKeeper(508): Node /hbase/namespace/hbase already exists and this is not a retry 2014-02-05 19:28:14,778 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2014-02-05 19:28:14,778 INFO [M:0;kiyo:48976] master.HMaster(924): Master has completed initialization 2014-02-05 19:28:14,864 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x6a098e27 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:14,886 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x6a098e27, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:14,888 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x6a098e27-0x144038588cb000b connected 2014-02-05 19:28:14,898 INFO [Thread-204] client.HConnectionManager$HConnectionImplementation(1856): Closing zookeeper sessionid=0x144038588cb000b 2014-02-05 19:28:14,915 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:14,945 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:14,947 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): hconnection-0x4fc6bde5-0x144038588cb000c connected 2014-02-05 19:28:14,947 INFO [Thread-204] hbase.HBaseTestingUtility(901): Minicluster is up 2014-02-05 19:28:14,971 INFO [FifoRpcScheduler.handler5-thread-4] master.HMaster(1735): Client=hortonzy//68.142.244.61 create 'observed_table', {NAME => 'aaa', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-02-05 19:28:15,038 DEBUG [FifoRpcScheduler.handler5-thread-4] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/observed_table/write-master:489760000000000 2014-02-05 19:28:15,094 INFO [MASTER_TABLE_OPERATIONS-kiyo:48976-0] handler.CreateTableHandler(148): Create table observed_table 2014-02-05 19:28:15,279 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:53087/user/hortonzy/hbase/.tmp/data/default/observed_table/.tabledesc/.tableinfo.0000000001 2014-02-05 19:28:15,282 INFO [RegionOpenAndInitThread-observed_table-1] regionserver.HRegion(4180): creating HRegion observed_table HTD == 'observed_table', {NAME => 'aaa', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:53087/user/hortonzy/hbase/.tmp Table name == observed_table 2014-02-05 19:28:15,534 INFO [kiyo.gq1.ygridcore.net,48976,1391628487578.splitLogManagerTimeoutMonitor] master.SplitLogManager(648): Garbage collecting all recovering regions. 2014-02-05 19:28:15,937 DEBUG [RegionOpenAndInitThread-observed_table-1] regionserver.HRegion(563): Instantiated observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:15,938 DEBUG [RegionOpenAndInitThread-observed_table-1] regionserver.HRegion(1039): Closing observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314.: disabling compactions & flushes 2014-02-05 19:28:15,938 DEBUG [RegionOpenAndInitThread-observed_table-1] regionserver.HRegion(1061): Updates disabled for region observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:15,938 INFO [RegionOpenAndInitThread-observed_table-1] regionserver.HRegion(1119): Closed observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:15,983 INFO [MASTER_TABLE_OPERATIONS-kiyo:48976-0] catalog.MetaEditor(278): Added 1 2014-02-05 19:28:15,984 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1453): Assigning 1 region(s) to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:15,984 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node 44f008bd721ba7eaa0b08b382d743314 with OFFLINE state 2014-02-05 19:28:16,094 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:16,094 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={44f008bd721ba7eaa0b08b382d743314 state=OFFLINE, ts=1391628495984, server=null}, server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,096 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={44f008bd721ba7eaa0b08b382d743314 state=OFFLINE, ts=1391628495984, server=null}, server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,097 INFO [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1504): kiyo.gq1.ygridcore.net,60181,1391628487831 unassigned znodes=1 of total=1 2014-02-05 19:28:16,098 INFO [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {44f008bd721ba7eaa0b08b382d743314 state=OFFLINE, ts=1391628495984, server=null} to {44f008bd721ba7eaa0b08b382d743314 state=PENDING_OPEN, ts=1391628496098, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,098 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.ServerManager(765): New admin connection to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,101 INFO [Priority.RpcServer.handler=0,port=60181] regionserver.HRegionServer(3594): Open observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:16,109 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 44f008bd721ba7eaa0b08b382d743314 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:16,109 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1628): Bulk assigning done for kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,145 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/44f008bd721ba7eaa0b08b382d743314 2014-02-05 19:28:16,145 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 44f008bd721ba7eaa0b08b382d743314 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:16,146 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(4366): Opening region: {ENCODED => 44f008bd721ba7eaa0b08b382d743314, NAME => 'observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314.', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:16,146 DEBUG [AM.ZK.Worker-pool15-t10] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=44f008bd721ba7eaa0b08b382d743314, current_state={44f008bd721ba7eaa0b08b382d743314 state=PENDING_OPEN, ts=1391628496098, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,146 INFO [RS_OPEN_REGION-kiyo:60181-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:16,146 INFO [AM.ZK.Worker-pool15-t10] master.RegionStates(316): Transitioned {44f008bd721ba7eaa0b08b382d743314 state=PENDING_OPEN, ts=1391628496098, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {44f008bd721ba7eaa0b08b382d743314 state=OPENING, ts=1391628496146, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,147 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 44f008bd721ba7eaa0b08b382d743314 2014-02-05 19:28:16,147 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(563): Instantiated observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:16,172 DEBUG [MASTER_TABLE_OPERATIONS-kiyo:48976-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/observed_table/write-master:489760000000000 2014-02-05 19:28:16,186 INFO [StoreOpener-44f008bd721ba7eaa0b08b382d743314-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:16,189 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/44f008bd721ba7eaa0b08b382d743314 2014-02-05 19:28:16,192 INFO [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(664): Onlined 44f008bd721ba7eaa0b08b382d743314; next sequenceid=1 2014-02-05 19:28:16,192 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 44f008bd721ba7eaa0b08b382d743314 2014-02-05 19:28:16,194 INFO [PostOpenDeployTasks:44f008bd721ba7eaa0b08b382d743314] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:16,203 INFO [PostOpenDeployTasks:44f008bd721ba7eaa0b08b382d743314] catalog.MetaEditor(464): Updated row observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,203 INFO [PostOpenDeployTasks:44f008bd721ba7eaa0b08b382d743314] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:16,204 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 44f008bd721ba7eaa0b08b382d743314 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:16,233 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/44f008bd721ba7eaa0b08b382d743314 2014-02-05 19:28:16,233 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 44f008bd721ba7eaa0b08b382d743314 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:16,234 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(379): Transitioned 44f008bd721ba7eaa0b08b382d743314 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,234 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(179): Opened observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,235 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=44f008bd721ba7eaa0b08b382d743314, current_state={44f008bd721ba7eaa0b08b382d743314 state=OPENING, ts=1391628496146, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,235 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {44f008bd721ba7eaa0b08b382d743314 state=OPENING, ts=1391628496146, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {44f008bd721ba7eaa0b08b382d743314 state=OPEN, ts=1391628496235, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,236 DEBUG [AM.ZK.Worker-pool15-t11] handler.OpenedRegionHandler(149): Handling OPENED of 44f008bd721ba7eaa0b08b382d743314 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:16,243 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:16,243 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6a00c0b6 2014-02-05 19:28:16,271 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/44f008bd721ba7eaa0b08b382d743314 2014-02-05 19:28:16,271 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:16,271 DEBUG [AM.ZK.Worker-pool15-t11] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 44f008bd721ba7eaa0b08b382d743314 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:16,273 DEBUG [AM.ZK.Worker-pool15-t13] master.AssignmentManager$4(1175): Znode observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. deleted, state: {44f008bd721ba7eaa0b08b382d743314 state=OPEN, ts=1391628496235, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,273 INFO [AM.ZK.Worker-pool15-t13] master.RegionStates(377): Onlined 44f008bd721ba7eaa0b08b382d743314 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,288 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:16,288 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:16,289 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb000d connected 2014-02-05 19:28:16,298 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6a00c0b6 2014-02-05 19:28:16,332 INFO [Thread-204] hbase.Waiter(174): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2014-02-05 19:28:16,349 DEBUG [Thread-204] client.ClientSmallScanner(136): Finished with small scan at {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:16,377 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314.{ENCODED => 44f008bd721ba7eaa0b08b382d743314, NAME => 'observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314.', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:16,385 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:16,390 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:16,395 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:16,401 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:16,407 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:16,412 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:16,417 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:16,423 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:16,428 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:16,434 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:16,439 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:16,444 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:16,449 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:16,454 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:16,459 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:16,464 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:16,469 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:16,474 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:16,479 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:16,484 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:16,489 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:16,494 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:16,499 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:16,504 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:16,509 DEBUG [Thread-204] catalog.MetaEditor(238): Added observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:16,509 INFO [Thread-204] hbase.HBaseTestingUtility(1938): createMultiRegions: deleting meta row -> observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:16,526 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:16,527 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7a3ecd2a 2014-02-05 19:28:16,545 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:16,545 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:16,546 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb000e connected 2014-02-05 19:28:16,561 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7a3ecd2a 2014-02-05 19:28:16,578 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:16,578 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1ef736d9 2014-02-05 19:28:16,591 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:16,592 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:16,593 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb000f connected 2014-02-05 19:28:16,597 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1ef736d9 2014-02-05 19:28:16,629 INFO [FifoRpcScheduler.handler5-thread-2] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:16,630 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1759): Force region state offline {3df75a9a574dc10fbcdf4e5edf1f804a state=OFFLINE, ts=1391628496629, server=null} 2014-02-05 19:28:16,630 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.; generated random plan=hri=observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:16,630 DEBUG [FifoRpcScheduler.handler5-thread-2] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 3df75a9a574dc10fbcdf4e5edf1f804a with OFFLINE state 2014-02-05 19:28:16,641 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:16,642 INFO [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1912): Assigning observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:16,642 INFO [FifoRpcScheduler.handler5-thread-2] master.RegionStates(316): Transitioned {3df75a9a574dc10fbcdf4e5edf1f804a state=OFFLINE, ts=1391628496630, server=null} to {3df75a9a574dc10fbcdf4e5edf1f804a state=PENDING_OPEN, ts=1391628496642, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,645 INFO [Priority.RpcServer.handler=1,port=60181] regionserver.HRegionServer(3594): Open observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:16,649 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 3df75a9a574dc10fbcdf4e5edf1f804a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:16,652 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:16,652 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@48d2674 2014-02-05 19:28:16,666 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 3df75a9a574dc10fbcdf4e5edf1f804a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:16,666 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:16,667 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(4366): Opening region: {ENCODED => 3df75a9a574dc10fbcdf4e5edf1f804a, NAME => 'observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.', STARTKEY => '', ENDKEY => 'bbb'} 2014-02-05 19:28:16,667 INFO [RS_OPEN_REGION-kiyo:60181-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:16,668 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:16,668 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(563): Instantiated observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:16,670 WARN [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:16,671 DEBUG [RS_OPEN_REGION-kiyo:60181-1] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:16,683 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:16,683 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:16,684 DEBUG [AM.ZK.Worker-pool15-t15] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=3df75a9a574dc10fbcdf4e5edf1f804a, current_state={3df75a9a574dc10fbcdf4e5edf1f804a state=PENDING_OPEN, ts=1391628496642, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,684 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0010 connected 2014-02-05 19:28:16,684 INFO [AM.ZK.Worker-pool15-t15] master.RegionStates(316): Transitioned {3df75a9a574dc10fbcdf4e5edf1f804a state=PENDING_OPEN, ts=1391628496642, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {3df75a9a574dc10fbcdf4e5edf1f804a state=OPENING, ts=1391628496684, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:16,690 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@48d2674 2014-02-05 19:28:16,715 INFO [FifoRpcScheduler.handler5-thread-4] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:16,715 DEBUG [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(1759): Force region state offline {a9404de25502388bb384642862829808 state=OFFLINE, ts=1391628496715, server=null} 2014-02-05 19:28:16,716 DEBUG [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,bbb,1391628496385.a9404de25502388bb384642862829808.; generated random plan=hri=observed_table,bbb,1391628496385.a9404de25502388bb384642862829808., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:16,716 DEBUG [FifoRpcScheduler.handler5-thread-4] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node a9404de25502388bb384642862829808 with OFFLINE state 2014-02-05 19:28:16,740 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:16,741 INFO [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(1912): Assigning observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:16,741 INFO [FifoRpcScheduler.handler5-thread-4] master.RegionStates(316): Transitioned {a9404de25502388bb384642862829808 state=OFFLINE, ts=1391628496716, server=null} to {a9404de25502388bb384642862829808 state=PENDING_OPEN, ts=1391628496741, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:16,742 INFO [Priority.RpcServer.handler=9,port=56349] regionserver.HRegionServer(3594): Open observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:16,750 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning a9404de25502388bb384642862829808 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:16,751 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:16,752 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6735e614 2014-02-05 19:28:16,774 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a9404de25502388bb384642862829808 2014-02-05 19:28:16,774 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node a9404de25502388bb384642862829808 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:16,775 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(4366): Opening region: {ENCODED => a9404de25502388bb384642862829808, NAME => 'observed_table,bbb,1391628496385.a9404de25502388bb384642862829808.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2014-02-05 19:28:16,775 INFO [RS_OPEN_REGION-kiyo:56349-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:16,776 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table a9404de25502388bb384642862829808 2014-02-05 19:28:16,776 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(563): Instantiated observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:16,778 WARN [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: a9404de25502388bb384642862829808 2014-02-05 19:28:16,779 DEBUG [RS_OPEN_REGION-kiyo:56349-1] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:16,800 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:16,801 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:16,802 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0011 connected 2014-02-05 19:28:16,801 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=a9404de25502388bb384642862829808, current_state={a9404de25502388bb384642862829808 state=PENDING_OPEN, ts=1391628496741, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:16,802 INFO [AM.ZK.Worker-pool15-t17] master.RegionStates(316): Transitioned {a9404de25502388bb384642862829808 state=PENDING_OPEN, ts=1391628496741, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {a9404de25502388bb384642862829808 state=OPENING, ts=1391628496802, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:16,808 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6735e614 2014-02-05 19:28:16,839 INFO [FifoRpcScheduler.handler5-thread-1] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:16,839 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1759): Force region state offline {03da4845c5557152ef77ea032b50a62f state=OFFLINE, ts=1391628496839, server=null} 2014-02-05 19:28:16,839 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f.; generated random plan=hri=observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:16,839 DEBUG [FifoRpcScheduler.handler5-thread-1] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 03da4845c5557152ef77ea032b50a62f with OFFLINE state 2014-02-05 19:28:16,863 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:16,864 INFO [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1912): Assigning observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:16,864 INFO [FifoRpcScheduler.handler5-thread-1] master.RegionStates(316): Transitioned {03da4845c5557152ef77ea032b50a62f state=OFFLINE, ts=1391628496839, server=null} to {03da4845c5557152ef77ea032b50a62f state=PENDING_OPEN, ts=1391628496864, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:16,865 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:16,869 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 03da4845c5557152ef77ea032b50a62f from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:16,870 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:16,871 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@3d3c59a 2014-02-05 19:28:16,888 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 03da4845c5557152ef77ea032b50a62f from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:16,888 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/03da4845c5557152ef77ea032b50a62f 2014-02-05 19:28:16,888 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(4366): Opening region: {ENCODED => 03da4845c5557152ef77ea032b50a62f, NAME => 'observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2014-02-05 19:28:16,889 INFO [RS_OPEN_REGION-kiyo:56349-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:16,890 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 03da4845c5557152ef77ea032b50a62f 2014-02-05 19:28:16,890 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(563): Instantiated observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:16,892 WARN [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 03da4845c5557152ef77ea032b50a62f 2014-02-05 19:28:16,893 DEBUG [RS_OPEN_REGION-kiyo:56349-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:16,909 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:16,909 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:16,910 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=03da4845c5557152ef77ea032b50a62f, current_state={03da4845c5557152ef77ea032b50a62f state=PENDING_OPEN, ts=1391628496864, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:16,910 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0012 connected 2014-02-05 19:28:16,910 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(316): Transitioned {03da4845c5557152ef77ea032b50a62f state=PENDING_OPEN, ts=1391628496864, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {03da4845c5557152ef77ea032b50a62f state=OPENING, ts=1391628496910, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:16,988 INFO [StoreOpener-3df75a9a574dc10fbcdf4e5edf1f804a-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:16,988 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@3d3c59a 2014-02-05 19:28:16,992 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:16,995 INFO [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(664): Onlined 3df75a9a574dc10fbcdf4e5edf1f804a; next sequenceid=1 2014-02-05 19:28:16,995 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:17,019 INFO [PostOpenDeployTasks:3df75a9a574dc10fbcdf4e5edf1f804a] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:17,027 INFO [FifoRpcScheduler.handler5-thread-3] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:17,027 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1759): Force region state offline {1cad9af5f8ac68730058bdcee6114108 state=OFFLINE, ts=1391628497027, server=null} 2014-02-05 19:28:17,027 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.; generated random plan=hri=observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:17,028 DEBUG [FifoRpcScheduler.handler5-thread-3] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 1cad9af5f8ac68730058bdcee6114108 with OFFLINE state 2014-02-05 19:28:17,030 INFO [PostOpenDeployTasks:3df75a9a574dc10fbcdf4e5edf1f804a] catalog.MetaEditor(464): Updated row observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,030 INFO [PostOpenDeployTasks:3df75a9a574dc10fbcdf4e5edf1f804a] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:17,030 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 3df75a9a574dc10fbcdf4e5edf1f804a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:17,058 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:17,059 INFO [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1912): Assigning observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,059 INFO [FifoRpcScheduler.handler5-thread-3] master.RegionStates(316): Transitioned {1cad9af5f8ac68730058bdcee6114108 state=OFFLINE, ts=1391628497028, server=null} to {1cad9af5f8ac68730058bdcee6114108 state=PENDING_OPEN, ts=1391628497059, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,061 INFO [Priority.RpcServer.handler=2,port=60181] regionserver.HRegionServer(3594): Open observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:17,074 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:17,074 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 3df75a9a574dc10fbcdf4e5edf1f804a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:17,074 DEBUG [RS_OPEN_REGION-kiyo:60181-1] handler.OpenRegionHandler(379): Transitioned 3df75a9a574dc10fbcdf4e5edf1f804a to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,074 DEBUG [RS_OPEN_REGION-kiyo:60181-1] handler.OpenRegionHandler(179): Opened observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,075 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=3df75a9a574dc10fbcdf4e5edf1f804a, current_state={3df75a9a574dc10fbcdf4e5edf1f804a state=OPENING, ts=1391628496684, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,075 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 1cad9af5f8ac68730058bdcee6114108 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,076 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(316): Transitioned {3df75a9a574dc10fbcdf4e5edf1f804a state=OPENING, ts=1391628496684, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {3df75a9a574dc10fbcdf4e5edf1f804a state=OPEN, ts=1391628497076, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,076 DEBUG [AM.ZK.Worker-pool15-t1] handler.OpenedRegionHandler(149): Handling OPENED of 3df75a9a574dc10fbcdf4e5edf1f804a from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:17,077 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:17,078 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5663489e 2014-02-05 19:28:17,188 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:17,188 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 1cad9af5f8ac68730058bdcee6114108 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,188 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:17,188 DEBUG [AM.ZK.Worker-pool15-t1] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 3df75a9a574dc10fbcdf4e5edf1f804a in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:17,188 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:17,189 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager$4(1175): Znode observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. deleted, state: {3df75a9a574dc10fbcdf4e5edf1f804a state=OPEN, ts=1391628497076, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,189 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(4366): Opening region: {ENCODED => 1cad9af5f8ac68730058bdcee6114108, NAME => 'observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2014-02-05 19:28:17,189 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(377): Onlined 3df75a9a574dc10fbcdf4e5edf1f804a on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,190 INFO [RS_OPEN_REGION-kiyo:60181-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:17,190 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:17,190 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(563): Instantiated observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:17,192 WARN [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:17,194 DEBUG [RS_OPEN_REGION-kiyo:60181-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:17,242 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:17,242 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=1cad9af5f8ac68730058bdcee6114108, current_state={1cad9af5f8ac68730058bdcee6114108 state=PENDING_OPEN, ts=1391628497059, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,243 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:17,243 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(316): Transitioned {1cad9af5f8ac68730058bdcee6114108 state=PENDING_OPEN, ts=1391628497059, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {1cad9af5f8ac68730058bdcee6114108 state=OPENING, ts=1391628497243, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,243 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0013 connected 2014-02-05 19:28:17,248 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5663489e 2014-02-05 19:28:17,277 INFO [FifoRpcScheduler.handler5-thread-5] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:17,277 DEBUG [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(1759): Force region state offline {71a91a67fd785fd7bb819d8ab083ee54 state=OFFLINE, ts=1391628497277, server=null} 2014-02-05 19:28:17,277 DEBUG [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54.; generated random plan=hri=observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:17,277 DEBUG [FifoRpcScheduler.handler5-thread-5] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 71a91a67fd785fd7bb819d8ab083ee54 with OFFLINE state 2014-02-05 19:28:17,326 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:17,326 INFO [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(1912): Assigning observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,327 INFO [FifoRpcScheduler.handler5-thread-5] master.RegionStates(316): Transitioned {71a91a67fd785fd7bb819d8ab083ee54 state=OFFLINE, ts=1391628497277, server=null} to {71a91a67fd785fd7bb819d8ab083ee54 state=PENDING_OPEN, ts=1391628497327, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,328 INFO [Priority.RpcServer.handler=8,port=56349] regionserver.HRegionServer(3594): Open observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:17,344 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 71a91a67fd785fd7bb819d8ab083ee54 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,346 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:17,346 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@4076adf8 2014-02-05 19:28:17,449 INFO [StoreOpener-03da4845c5557152ef77ea032b50a62f-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:17,452 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/03da4845c5557152ef77ea032b50a62f 2014-02-05 19:28:17,455 INFO [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(664): Onlined 03da4845c5557152ef77ea032b50a62f; next sequenceid=1 2014-02-05 19:28:17,455 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 03da4845c5557152ef77ea032b50a62f 2014-02-05 19:28:17,481 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/71a91a67fd785fd7bb819d8ab083ee54 2014-02-05 19:28:17,481 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 71a91a67fd785fd7bb819d8ab083ee54 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,481 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(4366): Opening region: {ENCODED => 71a91a67fd785fd7bb819d8ab083ee54, NAME => 'observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54.', STARTKEY => 'eee', ENDKEY => 'fff'} 2014-02-05 19:28:17,482 INFO [RS_OPEN_REGION-kiyo:56349-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:17,482 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 71a91a67fd785fd7bb819d8ab083ee54 2014-02-05 19:28:17,482 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(563): Instantiated observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:17,483 WARN [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 71a91a67fd785fd7bb819d8ab083ee54 2014-02-05 19:28:17,485 DEBUG [RS_OPEN_REGION-kiyo:56349-0] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:17,508 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:17,508 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:17,509 INFO [PostOpenDeployTasks:03da4845c5557152ef77ea032b50a62f] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:17,509 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0014 connected 2014-02-05 19:28:17,509 DEBUG [AM.ZK.Worker-pool15-t6] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=71a91a67fd785fd7bb819d8ab083ee54, current_state={71a91a67fd785fd7bb819d8ab083ee54 state=PENDING_OPEN, ts=1391628497327, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,510 INFO [AM.ZK.Worker-pool15-t6] master.RegionStates(316): Transitioned {71a91a67fd785fd7bb819d8ab083ee54 state=PENDING_OPEN, ts=1391628497327, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {71a91a67fd785fd7bb819d8ab083ee54 state=OPENING, ts=1391628497510, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,517 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@4076adf8 2014-02-05 19:28:17,519 INFO [PostOpenDeployTasks:03da4845c5557152ef77ea032b50a62f] catalog.MetaEditor(464): Updated row observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,519 INFO [PostOpenDeployTasks:03da4845c5557152ef77ea032b50a62f] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:17,520 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 03da4845c5557152ef77ea032b50a62f from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:17,564 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/03da4845c5557152ef77ea032b50a62f 2014-02-05 19:28:17,564 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 03da4845c5557152ef77ea032b50a62f from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:17,564 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(379): Transitioned 03da4845c5557152ef77ea032b50a62f to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,564 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(179): Opened observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,565 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=03da4845c5557152ef77ea032b50a62f, current_state={03da4845c5557152ef77ea032b50a62f state=OPENING, ts=1391628496910, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,565 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(316): Transitioned {03da4845c5557152ef77ea032b50a62f state=OPENING, ts=1391628496910, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {03da4845c5557152ef77ea032b50a62f state=OPEN, ts=1391628497565, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,565 DEBUG [AM.ZK.Worker-pool15-t8] handler.OpenedRegionHandler(149): Handling OPENED of 03da4845c5557152ef77ea032b50a62f from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:17,566 INFO [StoreOpener-a9404de25502388bb384642862829808-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:17,568 INFO [FifoRpcScheduler.handler5-thread-4] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:17,568 DEBUG [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(1759): Force region state offline {f6842668951720a44cfc14f734422d51 state=OFFLINE, ts=1391628497568, server=null} 2014-02-05 19:28:17,568 DEBUG [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.; generated random plan=hri=observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:17,568 DEBUG [FifoRpcScheduler.handler5-thread-4] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node f6842668951720a44cfc14f734422d51 with OFFLINE state 2014-02-05 19:28:17,569 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/a9404de25502388bb384642862829808 2014-02-05 19:28:17,572 INFO [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(664): Onlined a9404de25502388bb384642862829808; next sequenceid=1 2014-02-05 19:28:17,572 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node a9404de25502388bb384642862829808 2014-02-05 19:28:17,586 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/03da4845c5557152ef77ea032b50a62f 2014-02-05 19:28:17,586 DEBUG [AM.ZK.Worker-pool15-t8] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 03da4845c5557152ef77ea032b50a62f in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:17,586 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:17,587 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager$4(1175): Znode observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. deleted, state: {03da4845c5557152ef77ea032b50a62f state=OPEN, ts=1391628497565, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,587 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(377): Onlined 03da4845c5557152ef77ea032b50a62f on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,587 INFO [PostOpenDeployTasks:a9404de25502388bb384642862829808] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:17,592 INFO [StoreOpener-1cad9af5f8ac68730058bdcee6114108-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:17,595 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:17,598 INFO [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(664): Onlined 1cad9af5f8ac68730058bdcee6114108; next sequenceid=1 2014-02-05 19:28:17,598 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:17,600 INFO [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(1912): Assigning observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,600 INFO [PostOpenDeployTasks:1cad9af5f8ac68730058bdcee6114108] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:17,600 INFO [FifoRpcScheduler.handler5-thread-4] master.RegionStates(316): Transitioned {f6842668951720a44cfc14f734422d51 state=OFFLINE, ts=1391628497568, server=null} to {f6842668951720a44cfc14f734422d51 state=PENDING_OPEN, ts=1391628497600, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,602 INFO [Priority.RpcServer.handler=3,port=60181] regionserver.HRegionServer(3594): Open observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:17,607 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning f6842668951720a44cfc14f734422d51 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,609 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:17,609 INFO [PostOpenDeployTasks:a9404de25502388bb384642862829808] catalog.MetaEditor(464): Updated row observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,610 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1249a33f 2014-02-05 19:28:17,610 INFO [PostOpenDeployTasks:a9404de25502388bb384642862829808] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:17,611 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning a9404de25502388bb384642862829808 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:17,611 INFO [PostOpenDeployTasks:1cad9af5f8ac68730058bdcee6114108] catalog.MetaEditor(464): Updated row observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,611 INFO [PostOpenDeployTasks:1cad9af5f8ac68730058bdcee6114108] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:17,612 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 1cad9af5f8ac68730058bdcee6114108 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:17,623 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:17,623 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node f6842668951720a44cfc14f734422d51 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,624 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(4366): Opening region: {ENCODED => f6842668951720a44cfc14f734422d51, NAME => 'observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2014-02-05 19:28:17,625 INFO [RS_OPEN_REGION-kiyo:60181-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:17,626 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table f6842668951720a44cfc14f734422d51 2014-02-05 19:28:17,626 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(563): Instantiated observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:17,627 WARN [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: f6842668951720a44cfc14f734422d51 2014-02-05 19:28:17,629 DEBUG [RS_OPEN_REGION-kiyo:60181-0] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:17,640 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:17,641 DEBUG [AM.ZK.Worker-pool15-t10] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=f6842668951720a44cfc14f734422d51, current_state={f6842668951720a44cfc14f734422d51 state=PENDING_OPEN, ts=1391628497600, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,641 INFO [AM.ZK.Worker-pool15-t10] master.RegionStates(316): Transitioned {f6842668951720a44cfc14f734422d51 state=PENDING_OPEN, ts=1391628497600, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {f6842668951720a44cfc14f734422d51 state=OPENING, ts=1391628497641, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,642 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0015 connected 2014-02-05 19:28:17,642 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0015, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:17,666 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a9404de25502388bb384642862829808 2014-02-05 19:28:17,666 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node a9404de25502388bb384642862829808 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:17,666 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(379): Transitioned a9404de25502388bb384642862829808 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,666 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(179): Opened observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,691 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 1cad9af5f8ac68730058bdcee6114108 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:17,691 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:17,692 DEBUG [RS_OPEN_REGION-kiyo:60181-2] handler.OpenRegionHandler(379): Transitioned 1cad9af5f8ac68730058bdcee6114108 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,692 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=a9404de25502388bb384642862829808, current_state={a9404de25502388bb384642862829808 state=OPENING, ts=1391628496802, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,692 DEBUG [RS_OPEN_REGION-kiyo:60181-2] handler.OpenRegionHandler(179): Opened observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,692 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {a9404de25502388bb384642862829808 state=OPENING, ts=1391628496802, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {a9404de25502388bb384642862829808 state=OPEN, ts=1391628497692, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,693 DEBUG [AM.ZK.Worker-pool15-t11] handler.OpenedRegionHandler(149): Handling OPENED of a9404de25502388bb384642862829808 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:17,693 DEBUG [AM.ZK.Worker-pool15-t13] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=1cad9af5f8ac68730058bdcee6114108, current_state={1cad9af5f8ac68730058bdcee6114108 state=OPENING, ts=1391628497243, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,693 INFO [AM.ZK.Worker-pool15-t13] master.RegionStates(316): Transitioned {1cad9af5f8ac68730058bdcee6114108 state=OPENING, ts=1391628497243, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {1cad9af5f8ac68730058bdcee6114108 state=OPEN, ts=1391628497693, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,693 DEBUG [AM.ZK.Worker-pool15-t13] handler.OpenedRegionHandler(149): Handling OPENED of 1cad9af5f8ac68730058bdcee6114108 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:17,696 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1249a33f 2014-02-05 19:28:17,711 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/a9404de25502388bb384642862829808 2014-02-05 19:28:17,711 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:17,712 DEBUG [AM.ZK.Worker-pool15-t11] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node a9404de25502388bb384642862829808 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:17,712 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager$4(1175): Znode observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. deleted, state: {a9404de25502388bb384642862829808 state=OPEN, ts=1391628497692, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,712 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(377): Onlined a9404de25502388bb384642862829808 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,723 DEBUG [AM.ZK.Worker-pool15-t13] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 1cad9af5f8ac68730058bdcee6114108 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:17,723 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:17,724 DEBUG [AM.ZK.Worker-pool15-t15] master.AssignmentManager$4(1175): Znode observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. deleted, state: {1cad9af5f8ac68730058bdcee6114108 state=OPEN, ts=1391628497693, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:17,725 INFO [AM.ZK.Worker-pool15-t15] master.RegionStates(377): Onlined 1cad9af5f8ac68730058bdcee6114108 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:17,730 INFO [FifoRpcScheduler.handler5-thread-2] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:17,730 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1759): Force region state offline {9011eccd5484e8045dd3e70898d03e94 state=OFFLINE, ts=1391628497730, server=null} 2014-02-05 19:28:17,730 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94.; generated random plan=hri=observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:17,731 DEBUG [FifoRpcScheduler.handler5-thread-2] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 9011eccd5484e8045dd3e70898d03e94 with OFFLINE state 2014-02-05 19:28:17,748 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:17,749 INFO [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1912): Assigning observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,749 INFO [FifoRpcScheduler.handler5-thread-2] master.RegionStates(316): Transitioned {9011eccd5484e8045dd3e70898d03e94 state=OFFLINE, ts=1391628497731, server=null} to {9011eccd5484e8045dd3e70898d03e94 state=PENDING_OPEN, ts=1391628497749, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,750 INFO [Priority.RpcServer.handler=6,port=56349] regionserver.HRegionServer(3594): Open observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:17,754 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 9011eccd5484e8045dd3e70898d03e94 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,756 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:17,756 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@2deeb609 2014-02-05 19:28:17,773 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/9011eccd5484e8045dd3e70898d03e94 2014-02-05 19:28:17,773 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 9011eccd5484e8045dd3e70898d03e94 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,774 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(4366): Opening region: {ENCODED => 9011eccd5484e8045dd3e70898d03e94, NAME => 'observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2014-02-05 19:28:17,774 INFO [RS_OPEN_REGION-kiyo:56349-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:17,775 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 9011eccd5484e8045dd3e70898d03e94 2014-02-05 19:28:17,775 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(563): Instantiated observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:17,776 WARN [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 9011eccd5484e8045dd3e70898d03e94 2014-02-05 19:28:17,778 DEBUG [RS_OPEN_REGION-kiyo:56349-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:17,794 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:17,795 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:17,795 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=9011eccd5484e8045dd3e70898d03e94, current_state={9011eccd5484e8045dd3e70898d03e94 state=PENDING_OPEN, ts=1391628497749, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,795 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0016 connected 2014-02-05 19:28:17,795 INFO [AM.ZK.Worker-pool15-t17] master.RegionStates(316): Transitioned {9011eccd5484e8045dd3e70898d03e94 state=PENDING_OPEN, ts=1391628497749, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {9011eccd5484e8045dd3e70898d03e94 state=OPENING, ts=1391628497795, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,800 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@2deeb609 2014-02-05 19:28:17,826 INFO [FifoRpcScheduler.handler5-thread-3] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:17,827 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1759): Force region state offline {bc4d57d6d26dbf95cc733d4423dfcf71 state=OFFLINE, ts=1391628497826, server=null} 2014-02-05 19:28:17,827 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71.; generated random plan=hri=observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:17,827 DEBUG [FifoRpcScheduler.handler5-thread-3] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node bc4d57d6d26dbf95cc733d4423dfcf71 with OFFLINE state 2014-02-05 19:28:17,865 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:17,865 INFO [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1912): Assigning observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:17,866 INFO [FifoRpcScheduler.handler5-thread-3] master.RegionStates(316): Transitioned {bc4d57d6d26dbf95cc733d4423dfcf71 state=OFFLINE, ts=1391628497827, server=null} to {bc4d57d6d26dbf95cc733d4423dfcf71 state=PENDING_OPEN, ts=1391628497866, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,867 INFO [Priority.RpcServer.handler=9,port=56349] regionserver.HRegionServer(3594): Open observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:17,885 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning bc4d57d6d26dbf95cc733d4423dfcf71 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,887 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:17,887 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1a17e2e9 2014-02-05 19:28:17,906 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/bc4d57d6d26dbf95cc733d4423dfcf71 2014-02-05 19:28:17,906 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node bc4d57d6d26dbf95cc733d4423dfcf71 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:17,907 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(4366): Opening region: {ENCODED => bc4d57d6d26dbf95cc733d4423dfcf71, NAME => 'observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2014-02-05 19:28:17,907 INFO [RS_OPEN_REGION-kiyo:56349-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:17,908 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table bc4d57d6d26dbf95cc733d4423dfcf71 2014-02-05 19:28:17,908 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(563): Instantiated observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:17,923 WARN [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: bc4d57d6d26dbf95cc733d4423dfcf71 2014-02-05 19:28:17,924 DEBUG [RS_OPEN_REGION-kiyo:56349-1] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:17,945 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:17,946 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=bc4d57d6d26dbf95cc733d4423dfcf71, current_state={bc4d57d6d26dbf95cc733d4423dfcf71 state=PENDING_OPEN, ts=1391628497866, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,947 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:17,947 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0017 connected 2014-02-05 19:28:17,947 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(316): Transitioned {bc4d57d6d26dbf95cc733d4423dfcf71 state=PENDING_OPEN, ts=1391628497866, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {bc4d57d6d26dbf95cc733d4423dfcf71 state=OPENING, ts=1391628497947, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:17,952 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1a17e2e9 2014-02-05 19:28:17,979 INFO [FifoRpcScheduler.handler5-thread-1] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:17,979 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1759): Force region state offline {b33b2590e622c698e6ba5ab3cb993387 state=OFFLINE, ts=1391628497979, server=null} 2014-02-05 19:28:17,980 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.; generated random plan=hri=observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:17,980 DEBUG [FifoRpcScheduler.handler5-thread-1] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node b33b2590e622c698e6ba5ab3cb993387 with OFFLINE state 2014-02-05 19:28:18,168 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,170 INFO [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1912): Assigning observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,170 INFO [FifoRpcScheduler.handler5-thread-1] master.RegionStates(316): Transitioned {b33b2590e622c698e6ba5ab3cb993387 state=OFFLINE, ts=1391628497980, server=null} to {b33b2590e622c698e6ba5ab3cb993387 state=PENDING_OPEN, ts=1391628498170, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,171 INFO [Priority.RpcServer.handler=4,port=60181] regionserver.HRegionServer(3594): Open observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:18,174 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning b33b2590e622c698e6ba5ab3cb993387 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,176 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:18,176 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1f0cfa0e 2014-02-05 19:28:18,257 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:18,257 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node b33b2590e622c698e6ba5ab3cb993387 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,258 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(4366): Opening region: {ENCODED => b33b2590e622c698e6ba5ab3cb993387, NAME => 'observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2014-02-05 19:28:18,258 INFO [RS_OPEN_REGION-kiyo:60181-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:18,259 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:18,259 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(563): Instantiated observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:18,260 WARN [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:18,262 DEBUG [RS_OPEN_REGION-kiyo:60181-1] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:18,278 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:18,279 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0018 connected 2014-02-05 19:28:18,279 DEBUG [AM.ZK.Worker-pool15-t3] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=b33b2590e622c698e6ba5ab3cb993387, current_state={b33b2590e622c698e6ba5ab3cb993387 state=PENDING_OPEN, ts=1391628498170, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,279 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0018, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:18,279 INFO [AM.ZK.Worker-pool15-t3] master.RegionStates(316): Transitioned {b33b2590e622c698e6ba5ab3cb993387 state=PENDING_OPEN, ts=1391628498170, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {b33b2590e622c698e6ba5ab3cb993387 state=OPENING, ts=1391628498279, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,279 INFO [StoreOpener-9011eccd5484e8045dd3e70898d03e94-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:18,284 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1f0cfa0e 2014-02-05 19:28:18,310 INFO [FifoRpcScheduler.handler5-thread-3] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:18,310 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1759): Force region state offline {740d8ee103ea2c47a0694af96bbf1041 state=OFFLINE, ts=1391628498310, server=null} 2014-02-05 19:28:18,311 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041.; generated random plan=hri=observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:18,311 DEBUG [FifoRpcScheduler.handler5-thread-3] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 740d8ee103ea2c47a0694af96bbf1041 with OFFLINE state 2014-02-05 19:28:18,321 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/9011eccd5484e8045dd3e70898d03e94 2014-02-05 19:28:18,324 INFO [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(664): Onlined 9011eccd5484e8045dd3e70898d03e94; next sequenceid=1 2014-02-05 19:28:18,324 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 9011eccd5484e8045dd3e70898d03e94 2014-02-05 19:28:18,332 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,333 INFO [PostOpenDeployTasks:9011eccd5484e8045dd3e70898d03e94] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:18,333 INFO [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1912): Assigning observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,333 INFO [FifoRpcScheduler.handler5-thread-3] master.RegionStates(316): Transitioned {740d8ee103ea2c47a0694af96bbf1041 state=OFFLINE, ts=1391628498311, server=null} to {740d8ee103ea2c47a0694af96bbf1041 state=PENDING_OPEN, ts=1391628498333, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,334 INFO [Priority.RpcServer.handler=4,port=56349] regionserver.HRegionServer(3594): Open observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:18,338 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:18,339 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1b5d3277 2014-02-05 19:28:18,343 INFO [PostOpenDeployTasks:9011eccd5484e8045dd3e70898d03e94] catalog.MetaEditor(464): Updated row observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,343 INFO [PostOpenDeployTasks:9011eccd5484e8045dd3e70898d03e94] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:18,344 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 9011eccd5484e8045dd3e70898d03e94 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,366 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:18,366 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:18,367 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0019 connected 2014-02-05 19:28:18,390 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/9011eccd5484e8045dd3e70898d03e94 2014-02-05 19:28:18,390 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 9011eccd5484e8045dd3e70898d03e94 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,390 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(379): Transitioned 9011eccd5484e8045dd3e70898d03e94 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,390 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(179): Opened observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,392 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 740d8ee103ea2c47a0694af96bbf1041 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,392 DEBUG [AM.ZK.Worker-pool15-t4] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=9011eccd5484e8045dd3e70898d03e94, current_state={9011eccd5484e8045dd3e70898d03e94 state=OPENING, ts=1391628497795, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,392 INFO [AM.ZK.Worker-pool15-t4] master.RegionStates(316): Transitioned {9011eccd5484e8045dd3e70898d03e94 state=OPENING, ts=1391628497795, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {9011eccd5484e8045dd3e70898d03e94 state=OPEN, ts=1391628498392, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,392 DEBUG [AM.ZK.Worker-pool15-t4] handler.OpenedRegionHandler(149): Handling OPENED of 9011eccd5484e8045dd3e70898d03e94 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:18,396 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@1b5d3277 2014-02-05 19:28:18,406 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/740d8ee103ea2c47a0694af96bbf1041 2014-02-05 19:28:18,406 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 740d8ee103ea2c47a0694af96bbf1041 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,406 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(4366): Opening region: {ENCODED => 740d8ee103ea2c47a0694af96bbf1041, NAME => 'observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2014-02-05 19:28:18,407 INFO [RS_OPEN_REGION-kiyo:56349-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:18,407 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 740d8ee103ea2c47a0694af96bbf1041 2014-02-05 19:28:18,407 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(563): Instantiated observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:18,417 WARN [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 740d8ee103ea2c47a0694af96bbf1041 2014-02-05 19:28:18,418 DEBUG [RS_OPEN_REGION-kiyo:56349-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:18,431 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/9011eccd5484e8045dd3e70898d03e94 2014-02-05 19:28:18,431 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,432 DEBUG [AM.ZK.Worker-pool15-t4] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 9011eccd5484e8045dd3e70898d03e94 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:18,432 DEBUG [AM.ZK.Worker-pool15-t4] master.AssignmentManager$4(1175): Znode observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. deleted, state: {9011eccd5484e8045dd3e70898d03e94 state=OPEN, ts=1391628498392, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,432 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=740d8ee103ea2c47a0694af96bbf1041, current_state={740d8ee103ea2c47a0694af96bbf1041 state=PENDING_OPEN, ts=1391628498333, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,433 INFO [AM.ZK.Worker-pool15-t4] master.RegionStates(377): Onlined 9011eccd5484e8045dd3e70898d03e94 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,433 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(316): Transitioned {740d8ee103ea2c47a0694af96bbf1041 state=PENDING_OPEN, ts=1391628498333, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {740d8ee103ea2c47a0694af96bbf1041 state=OPENING, ts=1391628498433, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,438 INFO [FifoRpcScheduler.handler5-thread-2] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:18,438 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1759): Force region state offline {40eb44f442967c47f644d3a0dc1b4804 state=OFFLINE, ts=1391628498438, server=null} 2014-02-05 19:28:18,438 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804.; generated random plan=hri=observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:18,438 DEBUG [FifoRpcScheduler.handler5-thread-2] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 40eb44f442967c47f644d3a0dc1b4804 with OFFLINE state 2014-02-05 19:28:18,465 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,466 INFO [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1912): Assigning observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,466 INFO [FifoRpcScheduler.handler5-thread-2] master.RegionStates(316): Transitioned {40eb44f442967c47f644d3a0dc1b4804 state=OFFLINE, ts=1391628498438, server=null} to {40eb44f442967c47f644d3a0dc1b4804 state=PENDING_OPEN, ts=1391628498466, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,467 INFO [Priority.RpcServer.handler=8,port=56349] regionserver.HRegionServer(3594): Open observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:18,483 INFO [StoreOpener-f6842668951720a44cfc14f734422d51-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:18,486 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:18,488 INFO [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(664): Onlined f6842668951720a44cfc14f734422d51; next sequenceid=1 2014-02-05 19:28:18,488 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node f6842668951720a44cfc14f734422d51 2014-02-05 19:28:18,490 INFO [PostOpenDeployTasks:f6842668951720a44cfc14f734422d51] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:18,498 INFO [PostOpenDeployTasks:f6842668951720a44cfc14f734422d51] catalog.MetaEditor(464): Updated row observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,498 INFO [PostOpenDeployTasks:f6842668951720a44cfc14f734422d51] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:18,501 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning f6842668951720a44cfc14f734422d51 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,503 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:18,503 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@92affad 2014-02-05 19:28:18,514 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:18,515 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node f6842668951720a44cfc14f734422d51 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,515 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(379): Transitioned f6842668951720a44cfc14f734422d51 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,515 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(179): Opened observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,518 INFO [StoreOpener-71a91a67fd785fd7bb819d8ab083ee54-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:18,550 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/71a91a67fd785fd7bb819d8ab083ee54 2014-02-05 19:28:18,565 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:18,566 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=f6842668951720a44cfc14f734422d51, current_state={f6842668951720a44cfc14f734422d51 state=OPENING, ts=1391628497641, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,566 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:18,566 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(316): Transitioned {f6842668951720a44cfc14f734422d51 state=OPENING, ts=1391628497641, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {f6842668951720a44cfc14f734422d51 state=OPEN, ts=1391628498566, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,567 DEBUG [AM.ZK.Worker-pool15-t8] handler.OpenedRegionHandler(149): Handling OPENED of f6842668951720a44cfc14f734422d51 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:18,566 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb001a connected 2014-02-05 19:28:18,589 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:18,590 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,590 DEBUG [AM.ZK.Worker-pool15-t8] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node f6842668951720a44cfc14f734422d51 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:18,590 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager$4(1175): Znode observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. deleted, state: {f6842668951720a44cfc14f734422d51 state=OPEN, ts=1391628498566, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,590 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(377): Onlined f6842668951720a44cfc14f734422d51 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,592 INFO [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(664): Onlined 71a91a67fd785fd7bb819d8ab083ee54; next sequenceid=1 2014-02-05 19:28:18,592 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 71a91a67fd785fd7bb819d8ab083ee54 2014-02-05 19:28:18,592 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@92affad 2014-02-05 19:28:18,596 INFO [PostOpenDeployTasks:71a91a67fd785fd7bb819d8ab083ee54] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:18,598 INFO [StoreOpener-b33b2590e622c698e6ba5ab3cb993387-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:18,601 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:18,603 INFO [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(664): Onlined b33b2590e622c698e6ba5ab3cb993387; next sequenceid=1 2014-02-05 19:28:18,603 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:18,614 INFO [PostOpenDeployTasks:b33b2590e622c698e6ba5ab3cb993387] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:18,621 INFO [FifoRpcScheduler.handler5-thread-4] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:18,621 DEBUG [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(1759): Force region state offline {25ede678d83c1f7baa61b657a6f5c7a6 state=OFFLINE, ts=1391628498621, server=null} 2014-02-05 19:28:18,621 INFO [PostOpenDeployTasks:71a91a67fd785fd7bb819d8ab083ee54] catalog.MetaEditor(464): Updated row observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,622 DEBUG [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6.; generated random plan=hri=observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:18,622 DEBUG [FifoRpcScheduler.handler5-thread-4] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 25ede678d83c1f7baa61b657a6f5c7a6 with OFFLINE state 2014-02-05 19:28:18,622 INFO [PostOpenDeployTasks:71a91a67fd785fd7bb819d8ab083ee54] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:18,623 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 71a91a67fd785fd7bb819d8ab083ee54 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,624 INFO [PostOpenDeployTasks:b33b2590e622c698e6ba5ab3cb993387] catalog.MetaEditor(464): Updated row observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,624 INFO [PostOpenDeployTasks:b33b2590e622c698e6ba5ab3cb993387] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:18,625 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning b33b2590e622c698e6ba5ab3cb993387 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,679 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,706 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/71a91a67fd785fd7bb819d8ab083ee54 2014-02-05 19:28:18,707 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 71a91a67fd785fd7bb819d8ab083ee54 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,707 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(379): Transitioned 71a91a67fd785fd7bb819d8ab083ee54 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,707 INFO [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(1912): Assigning observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,707 INFO [FifoRpcScheduler.handler5-thread-4] master.RegionStates(316): Transitioned {25ede678d83c1f7baa61b657a6f5c7a6 state=OFFLINE, ts=1391628498622, server=null} to {25ede678d83c1f7baa61b657a6f5c7a6 state=PENDING_OPEN, ts=1391628498707, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,707 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(179): Opened observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,709 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=71a91a67fd785fd7bb819d8ab083ee54, current_state={71a91a67fd785fd7bb819d8ab083ee54 state=OPENING, ts=1391628497510, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,709 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 40eb44f442967c47f644d3a0dc1b4804 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,709 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {71a91a67fd785fd7bb819d8ab083ee54 state=OPENING, ts=1391628497510, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {71a91a67fd785fd7bb819d8ab083ee54 state=OPEN, ts=1391628498709, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,709 DEBUG [AM.ZK.Worker-pool15-t11] handler.OpenedRegionHandler(149): Handling OPENED of 71a91a67fd785fd7bb819d8ab083ee54 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:18,709 INFO [Priority.RpcServer.handler=4,port=56349] regionserver.HRegionServer(3594): Open observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:18,722 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:18,722 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node b33b2590e622c698e6ba5ab3cb993387 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,722 DEBUG [RS_OPEN_REGION-kiyo:60181-1] handler.OpenRegionHandler(379): Transitioned b33b2590e622c698e6ba5ab3cb993387 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,722 DEBUG [RS_OPEN_REGION-kiyo:60181-1] handler.OpenRegionHandler(179): Opened observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,723 DEBUG [AM.ZK.Worker-pool15-t13] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=b33b2590e622c698e6ba5ab3cb993387, current_state={b33b2590e622c698e6ba5ab3cb993387 state=OPENING, ts=1391628498279, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,723 INFO [AM.ZK.Worker-pool15-t13] master.RegionStates(316): Transitioned {b33b2590e622c698e6ba5ab3cb993387 state=OPENING, ts=1391628498279, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {b33b2590e622c698e6ba5ab3cb993387 state=OPEN, ts=1391628498723, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,724 DEBUG [AM.ZK.Worker-pool15-t13] handler.OpenedRegionHandler(149): Handling OPENED of b33b2590e622c698e6ba5ab3cb993387 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:18,725 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:18,725 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@39519ad7 2014-02-05 19:28:18,743 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/40eb44f442967c47f644d3a0dc1b4804 2014-02-05 19:28:18,743 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 40eb44f442967c47f644d3a0dc1b4804 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,744 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(4366): Opening region: {ENCODED => 40eb44f442967c47f644d3a0dc1b4804, NAME => 'observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2014-02-05 19:28:18,745 INFO [RS_OPEN_REGION-kiyo:56349-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:18,745 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 40eb44f442967c47f644d3a0dc1b4804 2014-02-05 19:28:18,745 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(563): Instantiated observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:18,750 WARN [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 40eb44f442967c47f644d3a0dc1b4804 2014-02-05 19:28:18,752 DEBUG [RS_OPEN_REGION-kiyo:56349-0] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:18,753 INFO [StoreOpener-740d8ee103ea2c47a0694af96bbf1041-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:18,765 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/71a91a67fd785fd7bb819d8ab083ee54 2014-02-05 19:28:18,765 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,765 DEBUG [AM.ZK.Worker-pool15-t11] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 71a91a67fd785fd7bb819d8ab083ee54 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:18,765 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager$4(1175): Znode observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. deleted, state: {71a91a67fd785fd7bb819d8ab083ee54 state=OPEN, ts=1391628498709, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,765 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(377): Onlined 71a91a67fd785fd7bb819d8ab083ee54 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,765 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:18,766 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:18,767 DEBUG [AM.ZK.Worker-pool15-t12] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=40eb44f442967c47f644d3a0dc1b4804, current_state={40eb44f442967c47f644d3a0dc1b4804 state=PENDING_OPEN, ts=1391628498466, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,767 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb001b connected 2014-02-05 19:28:18,767 INFO [AM.ZK.Worker-pool15-t12] master.RegionStates(316): Transitioned {40eb44f442967c47f644d3a0dc1b4804 state=PENDING_OPEN, ts=1391628498466, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {40eb44f442967c47f644d3a0dc1b4804 state=OPENING, ts=1391628498767, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,782 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:18,782 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,782 DEBUG [AM.ZK.Worker-pool15-t13] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node b33b2590e622c698e6ba5ab3cb993387 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:18,782 DEBUG [AM.ZK.Worker-pool15-t13] master.AssignmentManager$4(1175): Znode observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. deleted, state: {b33b2590e622c698e6ba5ab3cb993387 state=OPEN, ts=1391628498723, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,783 INFO [AM.ZK.Worker-pool15-t13] master.RegionStates(377): Onlined b33b2590e622c698e6ba5ab3cb993387 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,787 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@39519ad7 2014-02-05 19:28:18,794 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/740d8ee103ea2c47a0694af96bbf1041 2014-02-05 19:28:18,796 INFO [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(664): Onlined 740d8ee103ea2c47a0694af96bbf1041; next sequenceid=1 2014-02-05 19:28:18,797 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 740d8ee103ea2c47a0694af96bbf1041 2014-02-05 19:28:18,812 INFO [PostOpenDeployTasks:740d8ee103ea2c47a0694af96bbf1041] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:18,816 INFO [FifoRpcScheduler.handler5-thread-1] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:18,817 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1759): Force region state offline {969db37065123ffec5eded7ad35041a6 state=OFFLINE, ts=1391628498816, server=null} 2014-02-05 19:28:18,817 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.; generated random plan=hri=observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:18,817 DEBUG [FifoRpcScheduler.handler5-thread-1] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 969db37065123ffec5eded7ad35041a6 with OFFLINE state 2014-02-05 19:28:18,820 INFO [PostOpenDeployTasks:740d8ee103ea2c47a0694af96bbf1041] catalog.MetaEditor(464): Updated row observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,820 INFO [PostOpenDeployTasks:740d8ee103ea2c47a0694af96bbf1041] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:18,821 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 740d8ee103ea2c47a0694af96bbf1041 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,831 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,832 INFO [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1912): Assigning observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:18,832 INFO [FifoRpcScheduler.handler5-thread-1] master.RegionStates(316): Transitioned {969db37065123ffec5eded7ad35041a6 state=OFFLINE, ts=1391628498817, server=null} to {969db37065123ffec5eded7ad35041a6 state=PENDING_OPEN, ts=1391628498832, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,833 INFO [Priority.RpcServer.handler=5,port=60181] regionserver.HRegionServer(3594): Open observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:18,837 INFO [StoreOpener-bc4d57d6d26dbf95cc733d4423dfcf71-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:18,840 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/bc4d57d6d26dbf95cc733d4423dfcf71 2014-02-05 19:28:18,842 INFO [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(664): Onlined bc4d57d6d26dbf95cc733d4423dfcf71; next sequenceid=1 2014-02-05 19:28:18,842 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node bc4d57d6d26dbf95cc733d4423dfcf71 2014-02-05 19:28:18,876 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/740d8ee103ea2c47a0694af96bbf1041 2014-02-05 19:28:18,877 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 740d8ee103ea2c47a0694af96bbf1041 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,877 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(379): Transitioned 740d8ee103ea2c47a0694af96bbf1041 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,877 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(179): Opened observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,877 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 969db37065123ffec5eded7ad35041a6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,878 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 25ede678d83c1f7baa61b657a6f5c7a6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,878 INFO [PostOpenDeployTasks:bc4d57d6d26dbf95cc733d4423dfcf71] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:18,879 DEBUG [AM.ZK.Worker-pool15-t20] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=740d8ee103ea2c47a0694af96bbf1041, current_state={740d8ee103ea2c47a0694af96bbf1041 state=OPENING, ts=1391628498433, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,879 INFO [AM.ZK.Worker-pool15-t20] master.RegionStates(316): Transitioned {740d8ee103ea2c47a0694af96bbf1041 state=OPENING, ts=1391628498433, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {740d8ee103ea2c47a0694af96bbf1041 state=OPEN, ts=1391628498879, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,879 DEBUG [AM.ZK.Worker-pool15-t20] handler.OpenedRegionHandler(149): Handling OPENED of 740d8ee103ea2c47a0694af96bbf1041 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:18,880 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:18,880 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@3027f6fa 2014-02-05 19:28:18,892 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:18,892 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 969db37065123ffec5eded7ad35041a6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,892 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 25ede678d83c1f7baa61b657a6f5c7a6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:18,892 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/25ede678d83c1f7baa61b657a6f5c7a6 2014-02-05 19:28:18,893 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(4366): Opening region: {ENCODED => 969db37065123ffec5eded7ad35041a6, NAME => 'observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2014-02-05 19:28:18,893 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(4366): Opening region: {ENCODED => 25ede678d83c1f7baa61b657a6f5c7a6, NAME => 'observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2014-02-05 19:28:18,893 INFO [RS_OPEN_REGION-kiyo:60181-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:18,894 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:18,894 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(563): Instantiated observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:18,894 INFO [RS_OPEN_REGION-kiyo:56349-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:18,894 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 25ede678d83c1f7baa61b657a6f5c7a6 2014-02-05 19:28:18,895 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(563): Instantiated observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:18,895 WARN [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:18,896 WARN [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 25ede678d83c1f7baa61b657a6f5c7a6 2014-02-05 19:28:18,897 DEBUG [RS_OPEN_REGION-kiyo:60181-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:18,898 DEBUG [RS_OPEN_REGION-kiyo:56349-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:18,918 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/740d8ee103ea2c47a0694af96bbf1041 2014-02-05 19:28:18,918 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,918 DEBUG [AM.ZK.Worker-pool15-t20] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 740d8ee103ea2c47a0694af96bbf1041 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:18,919 DEBUG [AM.ZK.Worker-pool15-t20] master.AssignmentManager$4(1175): Znode observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. deleted, state: {740d8ee103ea2c47a0694af96bbf1041 state=OPEN, ts=1391628498879, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,919 INFO [AM.ZK.Worker-pool15-t20] master.RegionStates(377): Onlined 740d8ee103ea2c47a0694af96bbf1041 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,919 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:18,920 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=25ede678d83c1f7baa61b657a6f5c7a6, current_state={25ede678d83c1f7baa61b657a6f5c7a6 state=PENDING_OPEN, ts=1391628498707, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,920 DEBUG [AM.ZK.Worker-pool15-t3] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=969db37065123ffec5eded7ad35041a6, current_state={969db37065123ffec5eded7ad35041a6 state=PENDING_OPEN, ts=1391628498832, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,920 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(316): Transitioned {25ede678d83c1f7baa61b657a6f5c7a6 state=PENDING_OPEN, ts=1391628498707, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {25ede678d83c1f7baa61b657a6f5c7a6 state=OPENING, ts=1391628498920, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,921 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:18,921 INFO [AM.ZK.Worker-pool15-t3] master.RegionStates(316): Transitioned {969db37065123ffec5eded7ad35041a6 state=PENDING_OPEN, ts=1391628498832, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {969db37065123ffec5eded7ad35041a6 state=OPENING, ts=1391628498921, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:18,921 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb001c connected 2014-02-05 19:28:18,925 INFO [PostOpenDeployTasks:bc4d57d6d26dbf95cc733d4423dfcf71] catalog.MetaEditor(464): Updated row observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,925 INFO [PostOpenDeployTasks:bc4d57d6d26dbf95cc733d4423dfcf71] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:18,926 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning bc4d57d6d26dbf95cc733d4423dfcf71 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,927 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@3027f6fa 2014-02-05 19:28:18,973 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/bc4d57d6d26dbf95cc733d4423dfcf71 2014-02-05 19:28:18,973 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node bc4d57d6d26dbf95cc733d4423dfcf71 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:18,973 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(379): Transitioned bc4d57d6d26dbf95cc733d4423dfcf71 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,973 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(179): Opened observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:18,974 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=bc4d57d6d26dbf95cc733d4423dfcf71, current_state={bc4d57d6d26dbf95cc733d4423dfcf71 state=OPENING, ts=1391628497947, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,974 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(316): Transitioned {bc4d57d6d26dbf95cc733d4423dfcf71 state=OPENING, ts=1391628497947, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {bc4d57d6d26dbf95cc733d4423dfcf71 state=OPEN, ts=1391628498974, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,974 DEBUG [AM.ZK.Worker-pool15-t2] handler.OpenedRegionHandler(149): Handling OPENED of bc4d57d6d26dbf95cc733d4423dfcf71 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:18,976 INFO [FifoRpcScheduler.handler5-thread-5] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:18,976 DEBUG [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(1759): Force region state offline {5b68e755b91897693a8ee58eae204d9d state=OFFLINE, ts=1391628498976, server=null} 2014-02-05 19:28:18,976 DEBUG [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.; generated random plan=hri=observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:18,976 DEBUG [FifoRpcScheduler.handler5-thread-5] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 5b68e755b91897693a8ee58eae204d9d with OFFLINE state 2014-02-05 19:28:18,997 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/bc4d57d6d26dbf95cc733d4423dfcf71 2014-02-05 19:28:18,997 DEBUG [AM.ZK.Worker-pool15-t2] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node bc4d57d6d26dbf95cc733d4423dfcf71 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:18,997 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:18,998 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager$4(1175): Znode observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. deleted, state: {bc4d57d6d26dbf95cc733d4423dfcf71 state=OPEN, ts=1391628498974, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:18,998 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(377): Onlined bc4d57d6d26dbf95cc733d4423dfcf71 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,014 INFO [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(1912): Assigning observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,014 INFO [FifoRpcScheduler.handler5-thread-5] master.RegionStates(316): Transitioned {5b68e755b91897693a8ee58eae204d9d state=OFFLINE, ts=1391628498976, server=null} to {5b68e755b91897693a8ee58eae204d9d state=PENDING_OPEN, ts=1391628499014, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,015 INFO [Priority.RpcServer.handler=6,port=60181] regionserver.HRegionServer(3594): Open observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:19,018 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 5b68e755b91897693a8ee58eae204d9d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,020 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:19,020 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@80baa82 2014-02-05 19:28:19,064 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:19,064 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 5b68e755b91897693a8ee58eae204d9d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,065 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(4366): Opening region: {ENCODED => 5b68e755b91897693a8ee58eae204d9d, NAME => 'observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2014-02-05 19:28:19,066 INFO [RS_OPEN_REGION-kiyo:60181-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:19,066 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:19,066 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(563): Instantiated observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:19,068 WARN [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:19,069 DEBUG [RS_OPEN_REGION-kiyo:60181-0] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:19,080 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:19,081 DEBUG [AM.ZK.Worker-pool15-t10] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=5b68e755b91897693a8ee58eae204d9d, current_state={5b68e755b91897693a8ee58eae204d9d state=PENDING_OPEN, ts=1391628499014, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,082 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:19,082 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb001d connected 2014-02-05 19:28:19,082 INFO [AM.ZK.Worker-pool15-t10] master.RegionStates(316): Transitioned {5b68e755b91897693a8ee58eae204d9d state=PENDING_OPEN, ts=1391628499014, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {5b68e755b91897693a8ee58eae204d9d state=OPENING, ts=1391628499082, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,087 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@80baa82 2014-02-05 19:28:19,114 INFO [FifoRpcScheduler.handler5-thread-3] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:19,114 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1759): Force region state offline {4c5ec8b18f78d5d6c16c30f630223c3d state=OFFLINE, ts=1391628499114, server=null} 2014-02-05 19:28:19,115 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d.; generated random plan=hri=observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:19,115 DEBUG [FifoRpcScheduler.handler5-thread-3] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 4c5ec8b18f78d5d6c16c30f630223c3d with OFFLINE state 2014-02-05 19:28:19,131 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,132 INFO [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1912): Assigning observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,132 INFO [FifoRpcScheduler.handler5-thread-3] master.RegionStates(316): Transitioned {4c5ec8b18f78d5d6c16c30f630223c3d state=OFFLINE, ts=1391628499115, server=null} to {4c5ec8b18f78d5d6c16c30f630223c3d state=PENDING_OPEN, ts=1391628499132, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,133 INFO [Priority.RpcServer.handler=3,port=56349] regionserver.HRegionServer(3594): Open observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:19,157 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 4c5ec8b18f78d5d6c16c30f630223c3d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,159 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:19,160 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7082327f 2014-02-05 19:28:19,190 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/4c5ec8b18f78d5d6c16c30f630223c3d 2014-02-05 19:28:19,191 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 4c5ec8b18f78d5d6c16c30f630223c3d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,191 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(4366): Opening region: {ENCODED => 4c5ec8b18f78d5d6c16c30f630223c3d, NAME => 'observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2014-02-05 19:28:19,192 INFO [RS_OPEN_REGION-kiyo:56349-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:19,192 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 4c5ec8b18f78d5d6c16c30f630223c3d 2014-02-05 19:28:19,192 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(563): Instantiated observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:19,194 INFO [StoreOpener-25ede678d83c1f7baa61b657a6f5c7a6-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:19,196 WARN [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 4c5ec8b18f78d5d6c16c30f630223c3d 2014-02-05 19:28:19,197 DEBUG [RS_OPEN_REGION-kiyo:56349-1] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:19,198 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/25ede678d83c1f7baa61b657a6f5c7a6 2014-02-05 19:28:19,200 INFO [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(664): Onlined 25ede678d83c1f7baa61b657a6f5c7a6; next sequenceid=1 2014-02-05 19:28:19,201 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 25ede678d83c1f7baa61b657a6f5c7a6 2014-02-05 19:28:19,203 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:19,205 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb001e connected 2014-02-05 19:28:19,205 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=4c5ec8b18f78d5d6c16c30f630223c3d, current_state={4c5ec8b18f78d5d6c16c30f630223c3d state=PENDING_OPEN, ts=1391628499132, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,205 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb001e, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:19,205 INFO [PostOpenDeployTasks:25ede678d83c1f7baa61b657a6f5c7a6] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:19,205 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(316): Transitioned {4c5ec8b18f78d5d6c16c30f630223c3d state=PENDING_OPEN, ts=1391628499132, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {4c5ec8b18f78d5d6c16c30f630223c3d state=OPENING, ts=1391628499205, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,211 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7082327f 2014-02-05 19:28:19,213 INFO [PostOpenDeployTasks:25ede678d83c1f7baa61b657a6f5c7a6] catalog.MetaEditor(464): Updated row observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,213 INFO [PostOpenDeployTasks:25ede678d83c1f7baa61b657a6f5c7a6] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:19,214 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 25ede678d83c1f7baa61b657a6f5c7a6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,255 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/25ede678d83c1f7baa61b657a6f5c7a6 2014-02-05 19:28:19,255 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 25ede678d83c1f7baa61b657a6f5c7a6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,256 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(379): Transitioned 25ede678d83c1f7baa61b657a6f5c7a6 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,256 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(179): Opened observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,256 DEBUG [AM.ZK.Worker-pool15-t14] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=25ede678d83c1f7baa61b657a6f5c7a6, current_state={25ede678d83c1f7baa61b657a6f5c7a6 state=OPENING, ts=1391628498920, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,256 INFO [AM.ZK.Worker-pool15-t14] master.RegionStates(316): Transitioned {25ede678d83c1f7baa61b657a6f5c7a6 state=OPENING, ts=1391628498920, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {25ede678d83c1f7baa61b657a6f5c7a6 state=OPEN, ts=1391628499256, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,257 DEBUG [AM.ZK.Worker-pool15-t14] handler.OpenedRegionHandler(149): Handling OPENED of 25ede678d83c1f7baa61b657a6f5c7a6 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:19,259 INFO [FifoRpcScheduler.handler5-thread-2] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:19,259 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1759): Force region state offline {5d8421effa9ecd23359141f148ae1b66 state=OFFLINE, ts=1391628499259, server=null} 2014-02-05 19:28:19,259 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:19,259 DEBUG [FifoRpcScheduler.handler5-thread-2] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 5d8421effa9ecd23359141f148ae1b66 with OFFLINE state 2014-02-05 19:28:19,269 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/25ede678d83c1f7baa61b657a6f5c7a6 2014-02-05 19:28:19,269 DEBUG [AM.ZK.Worker-pool15-t14] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 25ede678d83c1f7baa61b657a6f5c7a6 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:19,269 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,269 DEBUG [AM.ZK.Worker-pool15-t14] master.AssignmentManager$4(1175): Znode observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. deleted, state: {25ede678d83c1f7baa61b657a6f5c7a6 state=OPEN, ts=1391628499256, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,270 INFO [AM.ZK.Worker-pool15-t14] master.RegionStates(377): Onlined 25ede678d83c1f7baa61b657a6f5c7a6 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,290 INFO [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,290 INFO [FifoRpcScheduler.handler5-thread-2] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=OFFLINE, ts=1391628499259, server=null} to {5d8421effa9ecd23359141f148ae1b66 state=PENDING_OPEN, ts=1391628499290, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,291 INFO [Priority.RpcServer.handler=7,port=60181] regionserver.HRegionServer(3594): Open observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:19,293 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 5d8421effa9ecd23359141f148ae1b66 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,295 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:19,296 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@3b93be92 2014-02-05 19:28:19,305 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:19,305 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 5d8421effa9ecd23359141f148ae1b66 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,305 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(4366): Opening region: {ENCODED => 5d8421effa9ecd23359141f148ae1b66, NAME => 'observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2014-02-05 19:28:19,306 INFO [RS_OPEN_REGION-kiyo:60181-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:19,306 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:19,307 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(563): Instantiated observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:19,309 WARN [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:19,310 DEBUG [RS_OPEN_REGION-kiyo:60181-1] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:19,339 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:19,339 DEBUG [AM.ZK.Worker-pool15-t15] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=5d8421effa9ecd23359141f148ae1b66, current_state={5d8421effa9ecd23359141f148ae1b66 state=PENDING_OPEN, ts=1391628499290, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,339 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:19,339 INFO [AM.ZK.Worker-pool15-t15] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=PENDING_OPEN, ts=1391628499290, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {5d8421effa9ecd23359141f148ae1b66 state=OPENING, ts=1391628499339, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,340 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb001f connected 2014-02-05 19:28:19,344 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@3b93be92 2014-02-05 19:28:19,366 INFO [StoreOpener-5b68e755b91897693a8ee58eae204d9d-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:19,370 INFO [FifoRpcScheduler.handler5-thread-1] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:19,370 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1759): Force region state offline {48619aa07760528441dedb46a46e4086 state=OFFLINE, ts=1391628499370, server=null} 2014-02-05 19:28:19,371 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086.; generated random plan=hri=observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:19,371 DEBUG [FifoRpcScheduler.handler5-thread-1] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 48619aa07760528441dedb46a46e4086 with OFFLINE state 2014-02-05 19:28:19,373 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:19,376 INFO [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(664): Onlined 5b68e755b91897693a8ee58eae204d9d; next sequenceid=1 2014-02-05 19:28:19,376 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:19,397 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,398 INFO [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1912): Assigning observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,398 INFO [PostOpenDeployTasks:5b68e755b91897693a8ee58eae204d9d] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:19,398 INFO [FifoRpcScheduler.handler5-thread-1] master.RegionStates(316): Transitioned {48619aa07760528441dedb46a46e4086 state=OFFLINE, ts=1391628499371, server=null} to {48619aa07760528441dedb46a46e4086 state=PENDING_OPEN, ts=1391628499398, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,399 INFO [Priority.RpcServer.handler=8,port=56349] regionserver.HRegionServer(3594): Open observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:19,405 INFO [PostOpenDeployTasks:5b68e755b91897693a8ee58eae204d9d] catalog.MetaEditor(464): Updated row observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,406 INFO [PostOpenDeployTasks:5b68e755b91897693a8ee58eae204d9d] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:19,407 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 5b68e755b91897693a8ee58eae204d9d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,409 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 48619aa07760528441dedb46a46e4086 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,410 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:19,411 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@34a5074f 2014-02-05 19:28:19,472 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:19,472 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 5b68e755b91897693a8ee58eae204d9d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,473 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(379): Transitioned 5b68e755b91897693a8ee58eae204d9d to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,473 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(179): Opened observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,482 INFO [StoreOpener-40eb44f442967c47f644d3a0dc1b4804-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:19,485 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/40eb44f442967c47f644d3a0dc1b4804 2014-02-05 19:28:19,487 INFO [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(664): Onlined 40eb44f442967c47f644d3a0dc1b4804; next sequenceid=1 2014-02-05 19:28:19,488 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 40eb44f442967c47f644d3a0dc1b4804 2014-02-05 19:28:19,488 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:19,489 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=5b68e755b91897693a8ee58eae204d9d, current_state={5b68e755b91897693a8ee58eae204d9d state=OPENING, ts=1391628499082, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,489 INFO [AM.ZK.Worker-pool15-t18] master.RegionStates(316): Transitioned {5b68e755b91897693a8ee58eae204d9d state=OPENING, ts=1391628499082, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {5b68e755b91897693a8ee58eae204d9d state=OPEN, ts=1391628499489, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,489 DEBUG [AM.ZK.Worker-pool15-t18] handler.OpenedRegionHandler(149): Handling OPENED of 5b68e755b91897693a8ee58eae204d9d from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:19,490 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0020 connected 2014-02-05 19:28:19,513 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/48619aa07760528441dedb46a46e4086 2014-02-05 19:28:19,513 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 48619aa07760528441dedb46a46e4086 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,514 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0020, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:19,514 INFO [PostOpenDeployTasks:40eb44f442967c47f644d3a0dc1b4804] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:19,514 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(4366): Opening region: {ENCODED => 48619aa07760528441dedb46a46e4086, NAME => 'observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2014-02-05 19:28:19,514 DEBUG [AM.ZK.Worker-pool15-t13] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=48619aa07760528441dedb46a46e4086, current_state={48619aa07760528441dedb46a46e4086 state=PENDING_OPEN, ts=1391628499398, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,515 INFO [AM.ZK.Worker-pool15-t13] master.RegionStates(316): Transitioned {48619aa07760528441dedb46a46e4086 state=PENDING_OPEN, ts=1391628499398, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {48619aa07760528441dedb46a46e4086 state=OPENING, ts=1391628499515, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,515 INFO [RS_OPEN_REGION-kiyo:56349-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:19,515 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 48619aa07760528441dedb46a46e4086 2014-02-05 19:28:19,515 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(563): Instantiated observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:19,517 INFO [StoreOpener-4c5ec8b18f78d5d6c16c30f630223c3d-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:19,518 WARN [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 48619aa07760528441dedb46a46e4086 2014-02-05 19:28:19,520 DEBUG [RS_OPEN_REGION-kiyo:56349-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:19,521 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/4c5ec8b18f78d5d6c16c30f630223c3d 2014-02-05 19:28:19,523 INFO [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(664): Onlined 4c5ec8b18f78d5d6c16c30f630223c3d; next sequenceid=1 2014-02-05 19:28:19,523 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 4c5ec8b18f78d5d6c16c30f630223c3d 2014-02-05 19:28:19,538 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:19,538 DEBUG [AM.ZK.Worker-pool15-t18] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 5b68e755b91897693a8ee58eae204d9d in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:19,538 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,539 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager$4(1175): Znode observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. deleted, state: {5b68e755b91897693a8ee58eae204d9d state=OPEN, ts=1391628499489, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,539 INFO [AM.ZK.Worker-pool15-t18] master.RegionStates(377): Onlined 5b68e755b91897693a8ee58eae204d9d on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,539 INFO [PostOpenDeployTasks:4c5ec8b18f78d5d6c16c30f630223c3d] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:19,542 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@34a5074f 2014-02-05 19:28:19,544 INFO [PostOpenDeployTasks:40eb44f442967c47f644d3a0dc1b4804] catalog.MetaEditor(464): Updated row observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,544 INFO [PostOpenDeployTasks:40eb44f442967c47f644d3a0dc1b4804] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:19,545 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 40eb44f442967c47f644d3a0dc1b4804 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,547 INFO [PostOpenDeployTasks:4c5ec8b18f78d5d6c16c30f630223c3d] catalog.MetaEditor(464): Updated row observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,547 INFO [PostOpenDeployTasks:4c5ec8b18f78d5d6c16c30f630223c3d] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:19,547 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 4c5ec8b18f78d5d6c16c30f630223c3d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,580 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/40eb44f442967c47f644d3a0dc1b4804 2014-02-05 19:28:19,580 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 40eb44f442967c47f644d3a0dc1b4804 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,580 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(379): Transitioned 40eb44f442967c47f644d3a0dc1b4804 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,580 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(179): Opened observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,590 INFO [StoreOpener-969db37065123ffec5eded7ad35041a6-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:19,593 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:19,595 INFO [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(664): Onlined 969db37065123ffec5eded7ad35041a6; next sequenceid=1 2014-02-05 19:28:19,595 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:19,605 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/4c5ec8b18f78d5d6c16c30f630223c3d 2014-02-05 19:28:19,605 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 4c5ec8b18f78d5d6c16c30f630223c3d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,605 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(379): Transitioned 4c5ec8b18f78d5d6c16c30f630223c3d to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,605 DEBUG [AM.ZK.Worker-pool15-t4] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=40eb44f442967c47f644d3a0dc1b4804, current_state={40eb44f442967c47f644d3a0dc1b4804 state=OPENING, ts=1391628498767, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,605 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(179): Opened observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,605 INFO [AM.ZK.Worker-pool15-t4] master.RegionStates(316): Transitioned {40eb44f442967c47f644d3a0dc1b4804 state=OPENING, ts=1391628498767, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {40eb44f442967c47f644d3a0dc1b4804 state=OPEN, ts=1391628499605, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,606 DEBUG [AM.ZK.Worker-pool15-t4] handler.OpenedRegionHandler(149): Handling OPENED of 40eb44f442967c47f644d3a0dc1b4804 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:19,606 DEBUG [AM.ZK.Worker-pool15-t20] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=4c5ec8b18f78d5d6c16c30f630223c3d, current_state={4c5ec8b18f78d5d6c16c30f630223c3d state=OPENING, ts=1391628499205, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,606 INFO [PostOpenDeployTasks:969db37065123ffec5eded7ad35041a6] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:19,606 INFO [AM.ZK.Worker-pool15-t20] master.RegionStates(316): Transitioned {4c5ec8b18f78d5d6c16c30f630223c3d state=OPENING, ts=1391628499205, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {4c5ec8b18f78d5d6c16c30f630223c3d state=OPEN, ts=1391628499606, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,606 DEBUG [AM.ZK.Worker-pool15-t20] handler.OpenedRegionHandler(149): Handling OPENED of 4c5ec8b18f78d5d6c16c30f630223c3d from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:19,608 INFO [FifoRpcScheduler.handler5-thread-2] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:19,608 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1759): Force region state offline {ff2b57089c32fcf1c14e7fc68c98400c state=OFFLINE, ts=1391628499608, server=null} 2014-02-05 19:28:19,609 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c.; generated random plan=hri=observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:19,609 DEBUG [FifoRpcScheduler.handler5-thread-2] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node ff2b57089c32fcf1c14e7fc68c98400c with OFFLINE state 2014-02-05 19:28:19,621 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/40eb44f442967c47f644d3a0dc1b4804 2014-02-05 19:28:19,621 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,621 DEBUG [AM.ZK.Worker-pool15-t4] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 40eb44f442967c47f644d3a0dc1b4804 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:19,622 DEBUG [AM.ZK.Worker-pool15-t4] master.AssignmentManager$4(1175): Znode observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. deleted, state: {40eb44f442967c47f644d3a0dc1b4804 state=OPEN, ts=1391628499605, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,622 INFO [AM.ZK.Worker-pool15-t4] master.RegionStates(377): Onlined 40eb44f442967c47f644d3a0dc1b4804 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,626 INFO [PostOpenDeployTasks:969db37065123ffec5eded7ad35041a6] catalog.MetaEditor(464): Updated row observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,626 INFO [PostOpenDeployTasks:969db37065123ffec5eded7ad35041a6] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:19,627 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 969db37065123ffec5eded7ad35041a6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,635 INFO [StoreOpener-5d8421effa9ecd23359141f148ae1b66-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:19,638 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:19,641 INFO [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(664): Onlined 5d8421effa9ecd23359141f148ae1b66; next sequenceid=1 2014-02-05 19:28:19,641 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:19,646 DEBUG [AM.ZK.Worker-pool15-t20] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 4c5ec8b18f78d5d6c16c30f630223c3d in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:19,647 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/4c5ec8b18f78d5d6c16c30f630223c3d 2014-02-05 19:28:19,647 DEBUG [AM.ZK.Worker-pool15-t3] master.AssignmentManager$4(1175): Znode observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. deleted, state: {4c5ec8b18f78d5d6c16c30f630223c3d state=OPEN, ts=1391628499606, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,647 INFO [AM.ZK.Worker-pool15-t3] master.RegionStates(377): Onlined 4c5ec8b18f78d5d6c16c30f630223c3d on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,648 INFO [PostOpenDeployTasks:5d8421effa9ecd23359141f148ae1b66] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:19,658 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,671 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 969db37065123ffec5eded7ad35041a6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,671 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:19,672 INFO [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1912): Assigning observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,672 INFO [FifoRpcScheduler.handler5-thread-2] master.RegionStates(316): Transitioned {ff2b57089c32fcf1c14e7fc68c98400c state=OFFLINE, ts=1391628499609, server=null} to {ff2b57089c32fcf1c14e7fc68c98400c state=PENDING_OPEN, ts=1391628499672, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,672 DEBUG [RS_OPEN_REGION-kiyo:60181-2] handler.OpenRegionHandler(379): Transitioned 969db37065123ffec5eded7ad35041a6 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,673 DEBUG [RS_OPEN_REGION-kiyo:60181-2] handler.OpenRegionHandler(179): Opened observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,673 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=969db37065123ffec5eded7ad35041a6, current_state={969db37065123ffec5eded7ad35041a6 state=OPENING, ts=1391628498921, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,673 INFO [Priority.RpcServer.handler=6,port=56349] regionserver.HRegionServer(3594): Open observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:19,673 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(316): Transitioned {969db37065123ffec5eded7ad35041a6 state=OPENING, ts=1391628498921, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {969db37065123ffec5eded7ad35041a6 state=OPEN, ts=1391628499673, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,673 DEBUG [AM.ZK.Worker-pool15-t2] handler.OpenedRegionHandler(149): Handling OPENED of 969db37065123ffec5eded7ad35041a6 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:19,678 INFO [PostOpenDeployTasks:5d8421effa9ecd23359141f148ae1b66] catalog.MetaEditor(464): Updated row observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,678 INFO [PostOpenDeployTasks:5d8421effa9ecd23359141f148ae1b66] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:19,678 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning 5d8421effa9ecd23359141f148ae1b66 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,697 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:19,697 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,697 DEBUG [AM.ZK.Worker-pool15-t2] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 969db37065123ffec5eded7ad35041a6 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:19,698 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager$4(1175): Znode observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. deleted, state: {969db37065123ffec5eded7ad35041a6 state=OPEN, ts=1391628499673, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,698 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(377): Onlined 969db37065123ffec5eded7ad35041a6 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,698 INFO [StoreOpener-48619aa07760528441dedb46a46e4086-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:19,701 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/48619aa07760528441dedb46a46e4086 2014-02-05 19:28:19,704 INFO [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(664): Onlined 48619aa07760528441dedb46a46e4086; next sequenceid=1 2014-02-05 19:28:19,704 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 48619aa07760528441dedb46a46e4086 2014-02-05 19:28:19,708 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:19,708 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node 5d8421effa9ecd23359141f148ae1b66 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,708 DEBUG [RS_OPEN_REGION-kiyo:60181-1] handler.OpenRegionHandler(379): Transitioned 5d8421effa9ecd23359141f148ae1b66 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,708 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning ff2b57089c32fcf1c14e7fc68c98400c from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,708 DEBUG [RS_OPEN_REGION-kiyo:60181-1] handler.OpenRegionHandler(179): Opened observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,709 INFO [PostOpenDeployTasks:48619aa07760528441dedb46a46e4086] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:19,709 DEBUG [AM.ZK.Worker-pool15-t9] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=5d8421effa9ecd23359141f148ae1b66, current_state={5d8421effa9ecd23359141f148ae1b66 state=OPENING, ts=1391628499339, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,709 INFO [AM.ZK.Worker-pool15-t9] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=OPENING, ts=1391628499339, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {5d8421effa9ecd23359141f148ae1b66 state=OPEN, ts=1391628499709, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,710 DEBUG [AM.ZK.Worker-pool15-t9] handler.OpenedRegionHandler(149): Handling OPENED of 5d8421effa9ecd23359141f148ae1b66 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:19,711 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:19,711 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@2103217a 2014-02-05 19:28:19,721 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node ff2b57089c32fcf1c14e7fc68c98400c from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,721 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/ff2b57089c32fcf1c14e7fc68c98400c 2014-02-05 19:28:19,722 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(4366): Opening region: {ENCODED => ff2b57089c32fcf1c14e7fc68c98400c, NAME => 'observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2014-02-05 19:28:19,722 INFO [RS_OPEN_REGION-kiyo:56349-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:19,723 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table ff2b57089c32fcf1c14e7fc68c98400c 2014-02-05 19:28:19,723 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(563): Instantiated observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:19,724 WARN [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: ff2b57089c32fcf1c14e7fc68c98400c 2014-02-05 19:28:19,726 DEBUG [RS_OPEN_REGION-kiyo:56349-0] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:19,726 INFO [PostOpenDeployTasks:48619aa07760528441dedb46a46e4086] catalog.MetaEditor(464): Updated row observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,726 INFO [PostOpenDeployTasks:48619aa07760528441dedb46a46e4086] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:19,729 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 48619aa07760528441dedb46a46e4086 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,730 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:19,731 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0021 connected 2014-02-05 19:28:19,755 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:19,755 DEBUG [AM.ZK.Worker-pool15-t9] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 5d8421effa9ecd23359141f148ae1b66 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:19,755 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,755 DEBUG [AM.ZK.Worker-pool15-t9] master.AssignmentManager$4(1175): Znode observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. deleted, state: {5d8421effa9ecd23359141f148ae1b66 state=OPEN, ts=1391628499709, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,755 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0021, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:19,755 INFO [AM.ZK.Worker-pool15-t9] master.RegionStates(377): Onlined 5d8421effa9ecd23359141f148ae1b66 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,755 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=ff2b57089c32fcf1c14e7fc68c98400c, current_state={ff2b57089c32fcf1c14e7fc68c98400c state=PENDING_OPEN, ts=1391628499672, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,756 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(316): Transitioned {ff2b57089c32fcf1c14e7fc68c98400c state=PENDING_OPEN, ts=1391628499672, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {ff2b57089c32fcf1c14e7fc68c98400c state=OPENING, ts=1391628499756, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,766 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/48619aa07760528441dedb46a46e4086 2014-02-05 19:28:19,766 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 48619aa07760528441dedb46a46e4086 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,767 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(379): Transitioned 48619aa07760528441dedb46a46e4086 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,767 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(179): Opened observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,767 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=48619aa07760528441dedb46a46e4086, current_state={48619aa07760528441dedb46a46e4086 state=OPENING, ts=1391628499515, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,768 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {48619aa07760528441dedb46a46e4086 state=OPENING, ts=1391628499515, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {48619aa07760528441dedb46a46e4086 state=OPEN, ts=1391628499768, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,768 DEBUG [AM.ZK.Worker-pool15-t11] handler.OpenedRegionHandler(149): Handling OPENED of 48619aa07760528441dedb46a46e4086 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:19,771 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@2103217a 2014-02-05 19:28:19,788 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/48619aa07760528441dedb46a46e4086 2014-02-05 19:28:19,788 DEBUG [AM.ZK.Worker-pool15-t11] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 48619aa07760528441dedb46a46e4086 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:19,788 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,789 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager$4(1175): Znode observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. deleted, state: {48619aa07760528441dedb46a46e4086 state=OPEN, ts=1391628499768, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,789 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(377): Onlined 48619aa07760528441dedb46a46e4086 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,802 INFO [FifoRpcScheduler.handler5-thread-3] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:19,802 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1759): Force region state offline {ccabdaf5066a8b10de484bf12a2ef38f state=OFFLINE, ts=1391628499802, server=null} 2014-02-05 19:28:19,802 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:19,803 DEBUG [FifoRpcScheduler.handler5-thread-3] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node ccabdaf5066a8b10de484bf12a2ef38f with OFFLINE state 2014-02-05 19:28:19,821 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,822 INFO [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,822 INFO [FifoRpcScheduler.handler5-thread-3] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=OFFLINE, ts=1391628499803, server=null} to {ccabdaf5066a8b10de484bf12a2ef38f state=PENDING_OPEN, ts=1391628499822, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,823 INFO [Priority.RpcServer.handler=8,port=60181] regionserver.HRegionServer(3594): Open observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:19,826 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning ccabdaf5066a8b10de484bf12a2ef38f from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,828 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:19,828 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@64cd144b 2014-02-05 19:28:19,846 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:19,846 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node ccabdaf5066a8b10de484bf12a2ef38f from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,847 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(4366): Opening region: {ENCODED => ccabdaf5066a8b10de484bf12a2ef38f, NAME => 'observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2014-02-05 19:28:19,848 INFO [RS_OPEN_REGION-kiyo:60181-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:19,848 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:19,848 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(563): Instantiated observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:19,850 WARN [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:19,851 DEBUG [RS_OPEN_REGION-kiyo:60181-0] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:19,854 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:19,855 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=ccabdaf5066a8b10de484bf12a2ef38f, current_state={ccabdaf5066a8b10de484bf12a2ef38f state=PENDING_OPEN, ts=1391628499822, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,855 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:19,855 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=PENDING_OPEN, ts=1391628499822, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {ccabdaf5066a8b10de484bf12a2ef38f state=OPENING, ts=1391628499855, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,856 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0022 connected 2014-02-05 19:28:19,860 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@64cd144b 2014-02-05 19:28:19,882 INFO [StoreOpener-ff2b57089c32fcf1c14e7fc68c98400c-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:19,884 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/ff2b57089c32fcf1c14e7fc68c98400c 2014-02-05 19:28:19,885 INFO [FifoRpcScheduler.handler5-thread-5] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:19,886 DEBUG [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(1759): Force region state offline {eb1ecc76644cb50a62647f4c2ef4a612 state=OFFLINE, ts=1391628499885, server=null} 2014-02-05 19:28:19,886 DEBUG [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:19,886 DEBUG [FifoRpcScheduler.handler5-thread-5] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node eb1ecc76644cb50a62647f4c2ef4a612 with OFFLINE state 2014-02-05 19:28:19,887 INFO [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(664): Onlined ff2b57089c32fcf1c14e7fc68c98400c; next sequenceid=1 2014-02-05 19:28:19,887 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node ff2b57089c32fcf1c14e7fc68c98400c 2014-02-05 19:28:19,888 INFO [PostOpenDeployTasks:ff2b57089c32fcf1c14e7fc68c98400c] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:19,896 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:19,898 INFO [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:19,898 INFO [FifoRpcScheduler.handler5-thread-5] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=OFFLINE, ts=1391628499886, server=null} to {eb1ecc76644cb50a62647f4c2ef4a612 state=PENDING_OPEN, ts=1391628499898, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,899 INFO [Priority.RpcServer.handler=9,port=60181] regionserver.HRegionServer(3594): Open observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:19,901 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning eb1ecc76644cb50a62647f4c2ef4a612 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,902 INFO [PostOpenDeployTasks:ff2b57089c32fcf1c14e7fc68c98400c] catalog.MetaEditor(464): Updated row observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,902 INFO [PostOpenDeployTasks:ff2b57089c32fcf1c14e7fc68c98400c] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:19,903 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning ff2b57089c32fcf1c14e7fc68c98400c from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,903 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:19,903 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6d19cdcf 2014-02-05 19:28:19,941 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node eb1ecc76644cb50a62647f4c2ef4a612 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:19,941 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:19,942 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(4366): Opening region: {ENCODED => eb1ecc76644cb50a62647f4c2ef4a612, NAME => 'observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2014-02-05 19:28:19,943 INFO [RS_OPEN_REGION-kiyo:60181-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:19,943 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:19,943 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(563): Instantiated observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:19,945 WARN [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:19,946 DEBUG [RS_OPEN_REGION-kiyo:60181-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:19,963 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:19,964 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0023 connected 2014-02-05 19:28:19,988 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node ff2b57089c32fcf1c14e7fc68c98400c from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:19,988 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/ff2b57089c32fcf1c14e7fc68c98400c 2014-02-05 19:28:19,988 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(379): Transitioned ff2b57089c32fcf1c14e7fc68c98400c to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,988 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=eb1ecc76644cb50a62647f4c2ef4a612, current_state={eb1ecc76644cb50a62647f4c2ef4a612 state=PENDING_OPEN, ts=1391628499898, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,988 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0023, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:19,989 INFO [AM.ZK.Worker-pool15-t17] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=PENDING_OPEN, ts=1391628499898, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {eb1ecc76644cb50a62647f4c2ef4a612 state=OPENING, ts=1391628499989, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:19,988 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(179): Opened observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:19,989 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=ff2b57089c32fcf1c14e7fc68c98400c, current_state={ff2b57089c32fcf1c14e7fc68c98400c state=OPENING, ts=1391628499756, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,989 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(316): Transitioned {ff2b57089c32fcf1c14e7fc68c98400c state=OPENING, ts=1391628499756, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {ff2b57089c32fcf1c14e7fc68c98400c state=OPEN, ts=1391628499989, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:19,990 DEBUG [AM.ZK.Worker-pool15-t1] handler.OpenedRegionHandler(149): Handling OPENED of ff2b57089c32fcf1c14e7fc68c98400c from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:20,013 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/ff2b57089c32fcf1c14e7fc68c98400c 2014-02-05 19:28:20,013 DEBUG [AM.ZK.Worker-pool15-t1] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node ff2b57089c32fcf1c14e7fc68c98400c in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:20,013 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:20,013 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager$4(1175): Znode observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. deleted, state: {ff2b57089c32fcf1c14e7fc68c98400c state=OPEN, ts=1391628499989, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,014 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(377): Onlined ff2b57089c32fcf1c14e7fc68c98400c on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:20,015 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@6d19cdcf 2014-02-05 19:28:20,044 INFO [FifoRpcScheduler.handler5-thread-4] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:20,044 DEBUG [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(1759): Force region state offline {1735b9d68af9b230db1e07759f36e2f7 state=OFFLINE, ts=1391628500044, server=null} 2014-02-05 19:28:20,044 DEBUG [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7.; generated random plan=hri=observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:20,044 DEBUG [FifoRpcScheduler.handler5-thread-4] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 1735b9d68af9b230db1e07759f36e2f7 with OFFLINE state 2014-02-05 19:28:20,063 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:20,064 INFO [FifoRpcScheduler.handler5-thread-4] master.AssignmentManager(1912): Assigning observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:20,064 INFO [FifoRpcScheduler.handler5-thread-4] master.RegionStates(316): Transitioned {1735b9d68af9b230db1e07759f36e2f7 state=OFFLINE, ts=1391628500044, server=null} to {1735b9d68af9b230db1e07759f36e2f7 state=PENDING_OPEN, ts=1391628500064, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,065 INFO [Priority.RpcServer.handler=7,port=56349] regionserver.HRegionServer(3594): Open observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:20,067 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 1735b9d68af9b230db1e07759f36e2f7 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:20,069 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:20,070 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@f8495b0 2014-02-05 19:28:20,088 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1735b9d68af9b230db1e07759f36e2f7 2014-02-05 19:28:20,088 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 1735b9d68af9b230db1e07759f36e2f7 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:20,088 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(4366): Opening region: {ENCODED => 1735b9d68af9b230db1e07759f36e2f7, NAME => 'observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2014-02-05 19:28:20,089 INFO [RS_OPEN_REGION-kiyo:56349-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:20,089 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 1735b9d68af9b230db1e07759f36e2f7 2014-02-05 19:28:20,090 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(563): Instantiated observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:20,091 WARN [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 1735b9d68af9b230db1e07759f36e2f7 2014-02-05 19:28:20,092 DEBUG [RS_OPEN_REGION-kiyo:56349-1] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:20,097 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:20,097 DEBUG [AM.ZK.Worker-pool15-t3] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=1735b9d68af9b230db1e07759f36e2f7, current_state={1735b9d68af9b230db1e07759f36e2f7 state=PENDING_OPEN, ts=1391628500064, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,097 INFO [AM.ZK.Worker-pool15-t3] master.RegionStates(316): Transitioned {1735b9d68af9b230db1e07759f36e2f7 state=PENDING_OPEN, ts=1391628500064, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {1735b9d68af9b230db1e07759f36e2f7 state=OPENING, ts=1391628500097, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,097 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:20,098 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0024 connected 2014-02-05 19:28:20,102 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@f8495b0 2014-02-05 19:28:20,120 INFO [FifoRpcScheduler.handler5-thread-1] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:20,120 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1759): Force region state offline {fa6cfdf1d37cc487932219986736fcd7 state=OFFLINE, ts=1391628500120, server=null} 2014-02-05 19:28:20,120 DEBUG [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:20,120 DEBUG [FifoRpcScheduler.handler5-thread-1] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node fa6cfdf1d37cc487932219986736fcd7 with OFFLINE state 2014-02-05 19:28:20,147 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:20,147 INFO [FifoRpcScheduler.handler5-thread-1] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,148 INFO [FifoRpcScheduler.handler5-thread-1] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=OFFLINE, ts=1391628500120, server=null} to {fa6cfdf1d37cc487932219986736fcd7 state=PENDING_OPEN, ts=1391628500148, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,148 INFO [StoreOpener-ccabdaf5066a8b10de484bf12a2ef38f-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:20,149 INFO [Priority.RpcServer.handler=0,port=60181] regionserver.HRegionServer(3594): Open observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:20,151 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:20,151 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning fa6cfdf1d37cc487932219986736fcd7 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:20,153 INFO [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(664): Onlined ccabdaf5066a8b10de484bf12a2ef38f; next sequenceid=1 2014-02-05 19:28:20,153 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:20,154 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:20,154 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@3f3c80e5 2014-02-05 19:28:20,172 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node fa6cfdf1d37cc487932219986736fcd7 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:20,172 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:20,172 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(4366): Opening region: {ENCODED => fa6cfdf1d37cc487932219986736fcd7, NAME => 'observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.', STARTKEY => 'vvv', ENDKEY => 'www'} 2014-02-05 19:28:20,173 INFO [RS_OPEN_REGION-kiyo:60181-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:20,173 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:20,174 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(563): Instantiated observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:20,176 INFO [StoreOpener-eb1ecc76644cb50a62647f4c2ef4a612-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:20,177 WARN [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:20,179 DEBUG [RS_OPEN_REGION-kiyo:60181-1] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:20,179 DEBUG [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:20,182 INFO [RS_OPEN_REGION-kiyo:60181-2] regionserver.HRegion(664): Onlined eb1ecc76644cb50a62647f4c2ef4a612; next sequenceid=1 2014-02-05 19:28:20,182 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:20,183 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:20,183 DEBUG [AM.ZK.Worker-pool15-t10] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=fa6cfdf1d37cc487932219986736fcd7, current_state={fa6cfdf1d37cc487932219986736fcd7 state=PENDING_OPEN, ts=1391628500148, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,184 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:20,184 INFO [PostOpenDeployTasks:eb1ecc76644cb50a62647f4c2ef4a612] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:20,184 INFO [AM.ZK.Worker-pool15-t10] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=PENDING_OPEN, ts=1391628500148, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {fa6cfdf1d37cc487932219986736fcd7 state=OPENING, ts=1391628500184, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,184 INFO [PostOpenDeployTasks:ccabdaf5066a8b10de484bf12a2ef38f] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:20,184 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0025 connected 2014-02-05 19:28:20,189 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@3f3c80e5 2014-02-05 19:28:20,191 INFO [PostOpenDeployTasks:ccabdaf5066a8b10de484bf12a2ef38f] catalog.MetaEditor(464): Updated row observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,191 INFO [PostOpenDeployTasks:ccabdaf5066a8b10de484bf12a2ef38f] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:20,191 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning ccabdaf5066a8b10de484bf12a2ef38f from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:20,191 INFO [PostOpenDeployTasks:eb1ecc76644cb50a62647f4c2ef4a612] catalog.MetaEditor(464): Updated row observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,192 INFO [PostOpenDeployTasks:eb1ecc76644cb50a62647f4c2ef4a612] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:20,192 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning eb1ecc76644cb50a62647f4c2ef4a612 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:20,229 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:20,229 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node ccabdaf5066a8b10de484bf12a2ef38f from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:20,229 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(379): Transitioned ccabdaf5066a8b10de484bf12a2ef38f to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,229 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(179): Opened observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,229 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:20,229 DEBUG [RS_OPEN_REGION-kiyo:60181-2] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node eb1ecc76644cb50a62647f4c2ef4a612 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:20,230 DEBUG [RS_OPEN_REGION-kiyo:60181-2] handler.OpenRegionHandler(379): Transitioned eb1ecc76644cb50a62647f4c2ef4a612 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,230 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=ccabdaf5066a8b10de484bf12a2ef38f, current_state={ccabdaf5066a8b10de484bf12a2ef38f state=OPENING, ts=1391628499855, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,230 DEBUG [RS_OPEN_REGION-kiyo:60181-2] handler.OpenRegionHandler(179): Opened observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,230 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=OPENING, ts=1391628499855, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {ccabdaf5066a8b10de484bf12a2ef38f state=OPEN, ts=1391628500230, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,230 DEBUG [AM.ZK.Worker-pool15-t5] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=eb1ecc76644cb50a62647f4c2ef4a612, current_state={eb1ecc76644cb50a62647f4c2ef4a612 state=OPENING, ts=1391628499989, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,230 DEBUG [AM.ZK.Worker-pool15-t2] handler.OpenedRegionHandler(149): Handling OPENED of ccabdaf5066a8b10de484bf12a2ef38f from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:20,231 INFO [AM.ZK.Worker-pool15-t5] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=OPENING, ts=1391628499989, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {eb1ecc76644cb50a62647f4c2ef4a612 state=OPEN, ts=1391628500231, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,231 DEBUG [AM.ZK.Worker-pool15-t5] handler.OpenedRegionHandler(149): Handling OPENED of eb1ecc76644cb50a62647f4c2ef4a612 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:20,232 INFO [FifoRpcScheduler.handler5-thread-2] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:20,233 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1759): Force region state offline {3c3390359fda1872fb2cecc76cfc3f71 state=OFFLINE, ts=1391628500232, server=null} 2014-02-05 19:28:20,233 DEBUG [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71.; generated random plan=hri=observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:20,233 DEBUG [FifoRpcScheduler.handler5-thread-2] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 3c3390359fda1872fb2cecc76cfc3f71 with OFFLINE state 2014-02-05 19:28:20,254 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:20,254 DEBUG [AM.ZK.Worker-pool15-t2] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node ccabdaf5066a8b10de484bf12a2ef38f in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:20,254 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:20,255 DEBUG [AM.ZK.Worker-pool15-t2] master.AssignmentManager$4(1175): Znode observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. deleted, state: {ccabdaf5066a8b10de484bf12a2ef38f state=OPEN, ts=1391628500230, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,255 INFO [AM.ZK.Worker-pool15-t2] master.RegionStates(377): Onlined ccabdaf5066a8b10de484bf12a2ef38f on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,321 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:20,322 DEBUG [AM.ZK.Worker-pool15-t5] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node eb1ecc76644cb50a62647f4c2ef4a612 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:20,322 DEBUG [AM.ZK.Worker-pool15-t5] master.AssignmentManager$4(1175): Znode observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. deleted, state: {eb1ecc76644cb50a62647f4c2ef4a612 state=OPEN, ts=1391628500231, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:20,322 INFO [AM.ZK.Worker-pool15-t5] master.RegionStates(377): Onlined eb1ecc76644cb50a62647f4c2ef4a612 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:20,331 INFO [StoreOpener-1735b9d68af9b230db1e07759f36e2f7-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:20,334 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/1735b9d68af9b230db1e07759f36e2f7 2014-02-05 19:28:20,336 INFO [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(664): Onlined 1735b9d68af9b230db1e07759f36e2f7; next sequenceid=1 2014-02-05 19:28:20,336 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 1735b9d68af9b230db1e07759f36e2f7 2014-02-05 19:28:20,345 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:20,346 INFO [PostOpenDeployTasks:1735b9d68af9b230db1e07759f36e2f7] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:20,347 INFO [FifoRpcScheduler.handler5-thread-2] master.AssignmentManager(1912): Assigning observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:20,347 INFO [FifoRpcScheduler.handler5-thread-2] master.RegionStates(316): Transitioned {3c3390359fda1872fb2cecc76cfc3f71 state=OFFLINE, ts=1391628500233, server=null} to {3c3390359fda1872fb2cecc76cfc3f71 state=PENDING_OPEN, ts=1391628500347, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,348 INFO [Priority.RpcServer.handler=3,port=56349] regionserver.HRegionServer(3594): Open observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:20,350 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 3c3390359fda1872fb2cecc76cfc3f71 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:20,352 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:20,352 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@f95c33a 2014-02-05 19:28:20,353 INFO [PostOpenDeployTasks:1735b9d68af9b230db1e07759f36e2f7] catalog.MetaEditor(464): Updated row observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:20,353 INFO [PostOpenDeployTasks:1735b9d68af9b230db1e07759f36e2f7] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:20,353 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 1735b9d68af9b230db1e07759f36e2f7 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:20,362 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3c3390359fda1872fb2cecc76cfc3f71 2014-02-05 19:28:20,362 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 3c3390359fda1872fb2cecc76cfc3f71 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:20,363 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(4366): Opening region: {ENCODED => 3c3390359fda1872fb2cecc76cfc3f71, NAME => 'observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71.', STARTKEY => 'www', ENDKEY => 'xxx'} 2014-02-05 19:28:20,363 INFO [RS_OPEN_REGION-kiyo:56349-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:20,364 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 3c3390359fda1872fb2cecc76cfc3f71 2014-02-05 19:28:20,364 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(563): Instantiated observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:20,365 WARN [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: 3c3390359fda1872fb2cecc76cfc3f71 2014-02-05 19:28:20,367 DEBUG [RS_OPEN_REGION-kiyo:56349-2] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:20,383 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:20,383 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:20,383 DEBUG [AM.ZK.Worker-pool15-t12] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=3c3390359fda1872fb2cecc76cfc3f71, current_state={3c3390359fda1872fb2cecc76cfc3f71 state=PENDING_OPEN, ts=1391628500347, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,384 INFO [AM.ZK.Worker-pool15-t12] master.RegionStates(316): Transitioned {3c3390359fda1872fb2cecc76cfc3f71 state=PENDING_OPEN, ts=1391628500347, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {3c3390359fda1872fb2cecc76cfc3f71 state=OPENING, ts=1391628500384, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,384 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0026 connected 2014-02-05 19:28:20,446 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1735b9d68af9b230db1e07759f36e2f7 2014-02-05 19:28:20,446 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 1735b9d68af9b230db1e07759f36e2f7 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:20,446 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(379): Transitioned 1735b9d68af9b230db1e07759f36e2f7 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:20,446 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(179): Opened observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:20,447 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=1735b9d68af9b230db1e07759f36e2f7, current_state={1735b9d68af9b230db1e07759f36e2f7 state=OPENING, ts=1391628500097, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,447 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {1735b9d68af9b230db1e07759f36e2f7 state=OPENING, ts=1391628500097, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {1735b9d68af9b230db1e07759f36e2f7 state=OPEN, ts=1391628500447, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,447 DEBUG [AM.ZK.Worker-pool15-t11] handler.OpenedRegionHandler(149): Handling OPENED of 1735b9d68af9b230db1e07759f36e2f7 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:20,449 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@f95c33a 2014-02-05 19:28:20,457 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1735b9d68af9b230db1e07759f36e2f7 2014-02-05 19:28:20,457 DEBUG [AM.ZK.Worker-pool15-t11] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 1735b9d68af9b230db1e07759f36e2f7 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:20,458 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:20,458 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager$4(1175): Znode observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. deleted, state: {1735b9d68af9b230db1e07759f36e2f7 state=OPEN, ts=1391628500447, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,458 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(377): Onlined 1735b9d68af9b230db1e07759f36e2f7 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:20,737 INFO [FifoRpcScheduler.handler5-thread-5] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:20,737 DEBUG [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(1759): Force region state offline {fcee8099129b38e885ccba14ea4fb14d state=OFFLINE, ts=1391628500737, server=null} 2014-02-05 19:28:20,737 DEBUG [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d.; generated random plan=hri=observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:20,737 DEBUG [FifoRpcScheduler.handler5-thread-5] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node fcee8099129b38e885ccba14ea4fb14d with OFFLINE state 2014-02-05 19:28:20,796 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:20,797 INFO [FifoRpcScheduler.handler5-thread-5] master.AssignmentManager(1912): Assigning observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:20,797 INFO [FifoRpcScheduler.handler5-thread-5] master.RegionStates(316): Transitioned {fcee8099129b38e885ccba14ea4fb14d state=OFFLINE, ts=1391628500737, server=null} to {fcee8099129b38e885ccba14ea4fb14d state=PENDING_OPEN, ts=1391628500797, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:20,798 INFO [Priority.RpcServer.handler=6,port=56349] regionserver.HRegionServer(3594): Open observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:20,800 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning fcee8099129b38e885ccba14ea4fb14d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:20,802 INFO [Thread-204] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x4fc6bde5 connecting to ZooKeeper ensemble=localhost:56427 2014-02-05 19:28:20,803 DEBUG [Thread-204] catalog.CatalogTracker(194): Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7904e8c4 2014-02-05 19:28:21,199 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/fcee8099129b38e885ccba14ea4fb14d 2014-02-05 19:28:21,199 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node fcee8099129b38e885ccba14ea4fb14d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:21,200 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(4366): Opening region: {ENCODED => fcee8099129b38e885ccba14ea4fb14d, NAME => 'observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2014-02-05 19:28:21,201 INFO [RS_OPEN_REGION-kiyo:56349-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:21,201 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table fcee8099129b38e885ccba14ea4fb14d 2014-02-05 19:28:21,201 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(563): Instantiated observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:21,203 WARN [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: fcee8099129b38e885ccba14ea4fb14d 2014-02-05 19:28:21,204 DEBUG [RS_OPEN_REGION-kiyo:56349-0] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:21,246 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-02-05 19:28:21,246 DEBUG [Thread-204] zookeeper.ZKUtil(428): catalogtracker-on-hconnection-0x4fc6bde5, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-02-05 19:28:21,246 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=fcee8099129b38e885ccba14ea4fb14d, current_state={fcee8099129b38e885ccba14ea4fb14d state=PENDING_OPEN, ts=1391628500797, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:21,246 INFO [AM.ZK.Worker-pool15-t18] master.RegionStates(316): Transitioned {fcee8099129b38e885ccba14ea4fb14d state=PENDING_OPEN, ts=1391628500797, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {fcee8099129b38e885ccba14ea4fb14d state=OPENING, ts=1391628501246, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:21,247 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(387): catalogtracker-on-hconnection-0x4fc6bde5-0x144038588cb0027 connected 2014-02-05 19:28:21,251 DEBUG [Thread-204] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7904e8c4 2014-02-05 19:28:21,293 INFO [FifoRpcScheduler.handler5-thread-3] master.HMaster(2476): Client=hortonzy//68.142.244.61 assign observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:21,293 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1759): Force region state offline {d71919231008406bacce304f6ca7b653 state=OFFLINE, ts=1391628501293, server=null} 2014-02-05 19:28:21,293 DEBUG [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,60181,1391628487831; 2 (online=2, available=2) available servers, forceNewPlan=true 2014-02-05 19:28:21,293 DEBUG [FifoRpcScheduler.handler5-thread-3] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node d71919231008406bacce304f6ca7b653 with OFFLINE state 2014-02-05 19:28:21,320 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:21,321 INFO [FifoRpcScheduler.handler5-thread-3] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:21,321 INFO [FifoRpcScheduler.handler5-thread-3] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=OFFLINE, ts=1391628501293, server=null} to {d71919231008406bacce304f6ca7b653 state=PENDING_OPEN, ts=1391628501321, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:21,322 INFO [Priority.RpcServer.handler=1,port=60181] regionserver.HRegionServer(3594): Open observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:21,325 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning d71919231008406bacce304f6ca7b653 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:21,326 INFO [Thread-204] hbase.Waiter(174): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2014-02-05 19:28:21,334 INFO [StoreOpener-3c3390359fda1872fb2cecc76cfc3f71-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:21,337 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/3c3390359fda1872fb2cecc76cfc3f71 2014-02-05 19:28:21,339 INFO [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(664): Onlined 3c3390359fda1872fb2cecc76cfc3f71; next sequenceid=1 2014-02-05 19:28:21,340 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 3c3390359fda1872fb2cecc76cfc3f71 2014-02-05 19:28:21,352 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d71919231008406bacce304f6ca7b653 2014-02-05 19:28:21,352 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node d71919231008406bacce304f6ca7b653 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:21,353 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(4366): Opening region: {ENCODED => d71919231008406bacce304f6ca7b653, NAME => 'observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.', STARTKEY => 'yyy', ENDKEY => ''} 2014-02-05 19:28:21,353 INFO [PostOpenDeployTasks:3c3390359fda1872fb2cecc76cfc3f71] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:21,353 DEBUG [AM.ZK.Worker-pool15-t4] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=d71919231008406bacce304f6ca7b653, current_state={d71919231008406bacce304f6ca7b653 state=PENDING_OPEN, ts=1391628501321, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:21,354 INFO [AM.ZK.Worker-pool15-t4] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=PENDING_OPEN, ts=1391628501321, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {d71919231008406bacce304f6ca7b653 state=OPENING, ts=1391628501354, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:21,354 INFO [RS_OPEN_REGION-kiyo:60181-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:21,354 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table d71919231008406bacce304f6ca7b653 2014-02-05 19:28:21,355 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(563): Instantiated observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:21,357 WARN [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegionFileSystem(750): .regioninfo file not found for region: d71919231008406bacce304f6ca7b653 2014-02-05 19:28:21,358 DEBUG [RS_OPEN_REGION-kiyo:60181-0] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create 2014-02-05 19:28:21,361 INFO [PostOpenDeployTasks:3c3390359fda1872fb2cecc76cfc3f71] catalog.MetaEditor(464): Updated row observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:21,361 INFO [PostOpenDeployTasks:3c3390359fda1872fb2cecc76cfc3f71] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:21,361 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 3c3390359fda1872fb2cecc76cfc3f71 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:21,373 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 3c3390359fda1872fb2cecc76cfc3f71 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:21,373 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3c3390359fda1872fb2cecc76cfc3f71 2014-02-05 19:28:21,373 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(379): Transitioned 3c3390359fda1872fb2cecc76cfc3f71 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:21,373 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(179): Opened observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:21,374 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=3c3390359fda1872fb2cecc76cfc3f71, current_state={3c3390359fda1872fb2cecc76cfc3f71 state=OPENING, ts=1391628500384, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:21,374 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(316): Transitioned {3c3390359fda1872fb2cecc76cfc3f71 state=OPENING, ts=1391628500384, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {3c3390359fda1872fb2cecc76cfc3f71 state=OPEN, ts=1391628501374, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:21,374 DEBUG [AM.ZK.Worker-pool15-t1] handler.OpenedRegionHandler(149): Handling OPENED of 3c3390359fda1872fb2cecc76cfc3f71 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:21,394 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/3c3390359fda1872fb2cecc76cfc3f71 2014-02-05 19:28:21,394 DEBUG [AM.ZK.Worker-pool15-t1] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 3c3390359fda1872fb2cecc76cfc3f71 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:21,394 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:21,395 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager$4(1175): Znode observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. deleted, state: {3c3390359fda1872fb2cecc76cfc3f71 state=OPEN, ts=1391628501374, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:21,395 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(377): Onlined 3c3390359fda1872fb2cecc76cfc3f71 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:21,492 INFO [StoreOpener-fa6cfdf1d37cc487932219986736fcd7-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:21,496 DEBUG [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:21,498 INFO [RS_OPEN_REGION-kiyo:60181-1] regionserver.HRegion(664): Onlined fa6cfdf1d37cc487932219986736fcd7; next sequenceid=1 2014-02-05 19:28:21,498 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:21,500 INFO [PostOpenDeployTasks:fa6cfdf1d37cc487932219986736fcd7] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:21,507 INFO [PostOpenDeployTasks:fa6cfdf1d37cc487932219986736fcd7] catalog.MetaEditor(464): Updated row observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:21,507 INFO [PostOpenDeployTasks:fa6cfdf1d37cc487932219986736fcd7] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:21,507 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning fa6cfdf1d37cc487932219986736fcd7 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:21,519 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:21,519 DEBUG [RS_OPEN_REGION-kiyo:60181-1] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node fa6cfdf1d37cc487932219986736fcd7 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:21,520 DEBUG [RS_OPEN_REGION-kiyo:60181-1] handler.OpenRegionHandler(379): Transitioned fa6cfdf1d37cc487932219986736fcd7 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:21,520 DEBUG [RS_OPEN_REGION-kiyo:60181-1] handler.OpenRegionHandler(179): Opened observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:21,520 DEBUG [AM.ZK.Worker-pool15-t3] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=fa6cfdf1d37cc487932219986736fcd7, current_state={fa6cfdf1d37cc487932219986736fcd7 state=OPENING, ts=1391628500184, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:21,520 INFO [AM.ZK.Worker-pool15-t3] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=OPENING, ts=1391628500184, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {fa6cfdf1d37cc487932219986736fcd7 state=OPEN, ts=1391628501520, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:21,521 DEBUG [AM.ZK.Worker-pool15-t3] handler.OpenedRegionHandler(149): Handling OPENED of fa6cfdf1d37cc487932219986736fcd7 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:21,536 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:21,536 DEBUG [AM.ZK.Worker-pool15-t3] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node fa6cfdf1d37cc487932219986736fcd7 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:21,536 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:21,536 DEBUG [AM.ZK.Worker-pool15-t3] master.AssignmentManager$4(1175): Znode observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. deleted, state: {fa6cfdf1d37cc487932219986736fcd7 state=OPEN, ts=1391628501520, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:21,536 INFO [AM.ZK.Worker-pool15-t3] master.RegionStates(377): Onlined fa6cfdf1d37cc487932219986736fcd7 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:21,855 INFO [StoreOpener-fcee8099129b38e885ccba14ea4fb14d-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:21,858 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/fcee8099129b38e885ccba14ea4fb14d 2014-02-05 19:28:21,861 INFO [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(664): Onlined fcee8099129b38e885ccba14ea4fb14d; next sequenceid=1 2014-02-05 19:28:21,861 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node fcee8099129b38e885ccba14ea4fb14d 2014-02-05 19:28:21,862 INFO [PostOpenDeployTasks:fcee8099129b38e885ccba14ea4fb14d] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:21,869 INFO [PostOpenDeployTasks:fcee8099129b38e885ccba14ea4fb14d] catalog.MetaEditor(464): Updated row observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:21,869 INFO [PostOpenDeployTasks:fcee8099129b38e885ccba14ea4fb14d] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:21,870 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning fcee8099129b38e885ccba14ea4fb14d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:21,927 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/fcee8099129b38e885ccba14ea4fb14d 2014-02-05 19:28:21,927 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node fcee8099129b38e885ccba14ea4fb14d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:21,927 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(379): Transitioned fcee8099129b38e885ccba14ea4fb14d to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:21,928 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(179): Opened observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:21,928 DEBUG [AM.ZK.Worker-pool15-t9] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=fcee8099129b38e885ccba14ea4fb14d, current_state={fcee8099129b38e885ccba14ea4fb14d state=OPENING, ts=1391628501246, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:21,928 INFO [AM.ZK.Worker-pool15-t9] master.RegionStates(316): Transitioned {fcee8099129b38e885ccba14ea4fb14d state=OPENING, ts=1391628501246, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {fcee8099129b38e885ccba14ea4fb14d state=OPEN, ts=1391628501928, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:21,929 DEBUG [AM.ZK.Worker-pool15-t9] handler.OpenedRegionHandler(149): Handling OPENED of fcee8099129b38e885ccba14ea4fb14d from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:21,961 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/fcee8099129b38e885ccba14ea4fb14d 2014-02-05 19:28:21,961 DEBUG [AM.ZK.Worker-pool15-t9] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node fcee8099129b38e885ccba14ea4fb14d in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:21,961 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:21,961 DEBUG [AM.ZK.Worker-pool15-t9] master.AssignmentManager$4(1175): Znode observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. deleted, state: {fcee8099129b38e885ccba14ea4fb14d state=OPEN, ts=1391628501928, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:21,962 INFO [AM.ZK.Worker-pool15-t9] master.RegionStates(377): Onlined fcee8099129b38e885ccba14ea4fb14d on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:21,987 INFO [StoreOpener-d71919231008406bacce304f6ca7b653-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:21,990 DEBUG [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/d71919231008406bacce304f6ca7b653 2014-02-05 19:28:21,992 INFO [RS_OPEN_REGION-kiyo:60181-0] regionserver.HRegion(664): Onlined d71919231008406bacce304f6ca7b653; next sequenceid=1 2014-02-05 19:28:21,993 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(644): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node d71919231008406bacce304f6ca7b653 2014-02-05 19:28:21,994 INFO [PostOpenDeployTasks:d71919231008406bacce304f6ca7b653] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:22,001 INFO [PostOpenDeployTasks:d71919231008406bacce304f6ca7b653] catalog.MetaEditor(464): Updated row observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. with server=kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,001 INFO [PostOpenDeployTasks:d71919231008406bacce304f6ca7b653] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:22,001 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(832): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioning d71919231008406bacce304f6ca7b653 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:22,014 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d71919231008406bacce304f6ca7b653 2014-02-05 19:28:22,014 DEBUG [RS_OPEN_REGION-kiyo:60181-0] zookeeper.ZKAssign(907): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Transitioned node d71919231008406bacce304f6ca7b653 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:22,014 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(379): Transitioned d71919231008406bacce304f6ca7b653 to OPENED in zk on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,014 DEBUG [RS_OPEN_REGION-kiyo:60181-0] handler.OpenRegionHandler(179): Opened observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,015 DEBUG [AM.ZK.Worker-pool15-t14] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,60181,1391628487831, region=d71919231008406bacce304f6ca7b653, current_state={d71919231008406bacce304f6ca7b653 state=OPENING, ts=1391628501354, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:22,015 INFO [AM.ZK.Worker-pool15-t14] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=OPENING, ts=1391628501354, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {d71919231008406bacce304f6ca7b653 state=OPEN, ts=1391628502015, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:22,015 DEBUG [AM.ZK.Worker-pool15-t14] handler.OpenedRegionHandler(149): Handling OPENED of d71919231008406bacce304f6ca7b653 from kiyo.gq1.ygridcore.net,60181,1391628487831; deleting unassigned node 2014-02-05 19:28:22,031 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/d71919231008406bacce304f6ca7b653 2014-02-05 19:28:22,031 DEBUG [AM.ZK.Worker-pool15-t14] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node d71919231008406bacce304f6ca7b653 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:22,031 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:22,031 DEBUG [AM.ZK.Worker-pool15-t14] master.AssignmentManager$4(1175): Znode observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. deleted, state: {d71919231008406bacce304f6ca7b653 state=OPEN, ts=1391628502015, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:22,031 INFO [AM.ZK.Worker-pool15-t14] master.RegionStates(377): Onlined d71919231008406bacce304f6ca7b653 on kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,040 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.{ENCODED => 3df75a9a574dc10fbcdf4e5edf1f804a, NAME => 'observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.', STARTKEY => '', ENDKEY => 'bbb'} 2014-02-05 19:28:22,040 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,bbb,1391628496385.a9404de25502388bb384642862829808.{ENCODED => a9404de25502388bb384642862829808, NAME => 'observed_table,bbb,1391628496385.a9404de25502388bb384642862829808.', STARTKEY => 'bbb', ENDKEY => 'ccc'} 2014-02-05 19:28:22,040 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f.{ENCODED => 03da4845c5557152ef77ea032b50a62f, NAME => 'observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f.', STARTKEY => 'ccc', ENDKEY => 'ddd'} 2014-02-05 19:28:22,040 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.{ENCODED => 1cad9af5f8ac68730058bdcee6114108, NAME => 'observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2014-02-05 19:28:22,041 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54.{ENCODED => 71a91a67fd785fd7bb819d8ab083ee54, NAME => 'observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54.', STARTKEY => 'eee', ENDKEY => 'fff'} 2014-02-05 19:28:22,041 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.{ENCODED => f6842668951720a44cfc14f734422d51, NAME => 'observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2014-02-05 19:28:22,041 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94.{ENCODED => 9011eccd5484e8045dd3e70898d03e94, NAME => 'observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94.', STARTKEY => 'ggg', ENDKEY => 'hhh'} 2014-02-05 19:28:22,041 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71.{ENCODED => bc4d57d6d26dbf95cc733d4423dfcf71, NAME => 'observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71.', STARTKEY => 'hhh', ENDKEY => 'iii'} 2014-02-05 19:28:22,041 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.{ENCODED => b33b2590e622c698e6ba5ab3cb993387, NAME => 'observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2014-02-05 19:28:22,042 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041.{ENCODED => 740d8ee103ea2c47a0694af96bbf1041, NAME => 'observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041.', STARTKEY => 'jjj', ENDKEY => 'kkk'} 2014-02-05 19:28:22,042 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804.{ENCODED => 40eb44f442967c47f644d3a0dc1b4804, NAME => 'observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804.', STARTKEY => 'kkk', ENDKEY => 'lll'} 2014-02-05 19:28:22,042 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6.{ENCODED => 25ede678d83c1f7baa61b657a6f5c7a6, NAME => 'observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6.', STARTKEY => 'lll', ENDKEY => 'mmm'} 2014-02-05 19:28:22,042 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.{ENCODED => 969db37065123ffec5eded7ad35041a6, NAME => 'observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2014-02-05 19:28:22,042 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.{ENCODED => 5b68e755b91897693a8ee58eae204d9d, NAME => 'observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2014-02-05 19:28:22,043 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d.{ENCODED => 4c5ec8b18f78d5d6c16c30f630223c3d, NAME => 'observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d.', STARTKEY => 'ooo', ENDKEY => 'ppp'} 2014-02-05 19:28:22,043 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.{ENCODED => 5d8421effa9ecd23359141f148ae1b66, NAME => 'observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2014-02-05 19:28:22,043 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086.{ENCODED => 48619aa07760528441dedb46a46e4086, NAME => 'observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086.', STARTKEY => 'qqq', ENDKEY => 'rrr'} 2014-02-05 19:28:22,043 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c.{ENCODED => ff2b57089c32fcf1c14e7fc68c98400c, NAME => 'observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c.', STARTKEY => 'rrr', ENDKEY => 'sss'} 2014-02-05 19:28:22,043 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.{ENCODED => ccabdaf5066a8b10de484bf12a2ef38f, NAME => 'observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.', STARTKEY => 'sss', ENDKEY => 'ttt'} 2014-02-05 19:28:22,044 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.{ENCODED => eb1ecc76644cb50a62647f4c2ef4a612, NAME => 'observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.', STARTKEY => 'ttt', ENDKEY => 'uuu'} 2014-02-05 19:28:22,044 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7.{ENCODED => 1735b9d68af9b230db1e07759f36e2f7, NAME => 'observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7.', STARTKEY => 'uuu', ENDKEY => 'vvv'} 2014-02-05 19:28:22,044 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.{ENCODED => fa6cfdf1d37cc487932219986736fcd7, NAME => 'observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.', STARTKEY => 'vvv', ENDKEY => 'www'} 2014-02-05 19:28:22,044 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71.{ENCODED => 3c3390359fda1872fb2cecc76cfc3f71, NAME => 'observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71.', STARTKEY => 'www', ENDKEY => 'xxx'} 2014-02-05 19:28:22,044 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d.{ENCODED => fcee8099129b38e885ccba14ea4fb14d, NAME => 'observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d.', STARTKEY => 'xxx', ENDKEY => 'yyy'} 2014-02-05 19:28:22,045 INFO [Thread-204] hbase.HBaseTestingUtility(2031): getMetaTableRows: row -> observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.{ENCODED => d71919231008406bacce304f6ca7b653, NAME => 'observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.', STARTKEY => 'yyy', ENDKEY => ''} 2014-02-05 19:28:22,045 DEBUG [Thread-204] hbase.HBaseTestingUtility(2072): Found 25 rows for table observed_table 2014-02-05 19:28:22,045 DEBUG [Thread-204] hbase.HBaseTestingUtility(2075): FirstRow=observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:22,063 ERROR [RpcServer.handler=0,port=60181] coprocessor.CoprocessorHost(760): The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception java.lang.NullPointerException at org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver.prePut(TestRegionServerCoprocessorExceptionWithAbort.java:160) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:1122) at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:2161) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2136) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2092) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2096) at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4200) at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3441) at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3345) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28460) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:22,063 FATAL [RpcServer.handler=0,port=60181] regionserver.HRegionServer(1796): ABORTING region server kiyo.gq1.ygridcore.net,60181,1391628487831: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception java.lang.NullPointerException at org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver.prePut(TestRegionServerCoprocessorExceptionWithAbort.java:160) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:1122) at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:2161) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2136) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2092) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2096) at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4200) at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3441) at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3345) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28460) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:22,063 FATAL [RpcServer.handler=0,port=60181] regionserver.HRegionServer(1804): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint, org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver] 2014-02-05 19:28:22,066 ERROR [FifoRpcScheduler.handler5-thread-5] master.HMaster(1359): Region server kiyo.gq1.ygridcore.net,60181,1391628487831 reported a fatal error: ABORTING region server kiyo.gq1.ygridcore.net,60181,1391628487831: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception Cause: java.lang.NullPointerException at org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver.prePut(TestRegionServerCoprocessorExceptionWithAbort.java:160) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:1122) at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:2161) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2136) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2092) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2096) at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4200) at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3441) at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3345) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28460) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:22,066 INFO [RpcServer.handler=0,port=60181] regionserver.HRegionServer(1730): STOPPED: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception 2014-02-05 19:28:22,071 INFO [RS:1;kiyo:60181] regionserver.SplitLogWorker(606): Sending interrupt to stop the worker thread 2014-02-05 19:28:22,074 DEBUG [RpcServer.handler=0,port=60181] wal.FSHLog(1360): interrupted while waiting for notification from AsyncNotifier 2014-02-05 19:28:22,074 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,60181,1391628487831] regionserver.SplitLogWorker(297): SplitLogWorker interrupted while waiting for task, exiting: java.lang.InterruptedException 2014-02-05 19:28:22,074 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(914): Stopping infoServer 2014-02-05 19:28:22,075 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,60181,1391628487831] regionserver.SplitLogWorker(214): SplitLogWorker kiyo.gq1.ygridcore.net,60181,1391628487831 exiting 2014-02-05 19:28:22,076 INFO [RS:1;kiyo:60181] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-02-05 19:28:22,080 WARN [RpcServer.handler=0,port=60181] ipc.RpcServer$Responder(1041): RpcServer.respondercallId: 151 service: ClientService methodName: Multi size: 139.0 connection: 68.142.244.61:44260: output error 2014-02-05 19:28:22,081 WARN [RpcServer.handler=0,port=60181] ipc.CallRunner(129): RpcServer.handler=0,port=60181: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null 2014-02-05 19:28:22,153 INFO [RS:1;kiyo:60181.logRoller] regionserver.LogRoller(120): LogRoller exiting. 2014-02-05 19:28:22,154 INFO [Thread-330] regionserver.MemStoreFlusher$FlushHandler(269): Thread-330 exiting 2014-02-05 19:28:22,154 INFO [RS:1;kiyo:60181.periodicFlusher] hbase.Chore(93): RS:1;kiyo:60181.periodicFlusher exiting 2014-02-05 19:28:22,155 INFO [RS:1;kiyo:60181.leaseChecker] regionserver.Leases(147): RS:1;kiyo:60181.leaseChecker closing leases 2014-02-05 19:28:22,155 INFO [RS:1;kiyo:60181.leaseChecker] regionserver.Leases(150): RS:1;kiyo:60181.leaseChecker closed leases 2014-02-05 19:28:22,155 INFO [RS:1;kiyo:60181.compactionChecker] hbase.Chore(93): RS:1;kiyo:60181.compactionChecker exiting 2014-02-05 19:28:22,181 INFO [RS:1;kiyo:60181] snapshot.RegionServerSnapshotManager(152): Stopping RegionServerSnapshotManager abruptly. 2014-02-05 19:28:22,181 INFO [RS:1;kiyo:60181.nonceCleaner] hbase.Chore(93): RS:1;kiyo:60181.nonceCleaner exiting 2014-02-05 19:28:22,182 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] handler.CloseRegionHandler(125): Processing close of observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:22,183 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1039): Closing observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.: disabling compactions & flushes 2014-02-05 19:28:22,183 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] handler.CloseRegionHandler(125): Processing close of observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:22,183 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1061): Updates disabled for region observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:22,184 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1039): Closing observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314.: disabling compactions & flushes 2014-02-05 19:28:22,184 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] handler.CloseRegionHandler(125): Processing close of observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:22,184 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1061): Updates disabled for region observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:22,185 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1039): Closing observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.: disabling compactions & flushes 2014-02-05 19:28:22,185 INFO [StoreCloserThread-observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,185 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1061): Updates disabled for region observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:22,186 INFO [StoreCloserThread-observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,186 INFO [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1119): Closed observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:22,186 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(956): aborting server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,186 DEBUG [RS:1;kiyo:60181] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@544216e 2014-02-05 19:28:22,186 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] handler.CloseRegionHandler(176): Closed observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:22,186 INFO [RS:1;kiyo:60181] client.HConnectionManager$HConnectionImplementation(1856): Closing zookeeper sessionid=0x144038588cb0005 2014-02-05 19:28:22,187 INFO [StoreCloserThread-observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,186 INFO [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1119): Closed observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:22,187 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] handler.CloseRegionHandler(176): Closed observed_table,,1391628494970.44f008bd721ba7eaa0b08b382d743314. 2014-02-05 19:28:22,187 INFO [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1119): Closed observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:22,187 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] handler.CloseRegionHandler(125): Processing close of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:22,186 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] handler.CloseRegionHandler(125): Processing close of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:22,187 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] handler.CloseRegionHandler(176): Closed observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:22,188 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1039): Closing observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.: disabling compactions & flushes 2014-02-05 19:28:22,189 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1039): Closing observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.: disabling compactions & flushes 2014-02-05 19:28:22,188 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] handler.CloseRegionHandler(125): Processing close of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:22,189 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1061): Updates disabled for region observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:22,190 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1039): Closing observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.: disabling compactions & flushes 2014-02-05 19:28:22,189 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1061): Updates disabled for region observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:22,190 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1061): Updates disabled for region observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:22,190 INFO [StoreCloserThread-observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,191 INFO [StoreCloserThread-observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,191 INFO [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1119): Closed observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:22,191 INFO [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1119): Closed observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:22,191 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] handler.CloseRegionHandler(176): Closed observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:22,191 INFO [StoreCloserThread-observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,191 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] handler.CloseRegionHandler(125): Processing close of observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:22,191 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] handler.CloseRegionHandler(176): Closed observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:22,192 INFO [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1119): Closed observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:22,192 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1039): Closing observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.: disabling compactions & flushes 2014-02-05 19:28:22,192 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1061): Updates disabled for region observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:22,192 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] handler.CloseRegionHandler(176): Closed observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:22,192 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] handler.CloseRegionHandler(125): Processing close of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:22,193 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] handler.CloseRegionHandler(125): Processing close of observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:22,193 INFO [StoreCloserThread-observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,193 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1039): Closing observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.: disabling compactions & flushes 2014-02-05 19:28:22,194 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1061): Updates disabled for region observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:22,194 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1039): Closing observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.: disabling compactions & flushes 2014-02-05 19:28:22,194 INFO [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1119): Closed observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:22,194 INFO [StoreCloserThread-observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,194 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] handler.CloseRegionHandler(176): Closed observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:22,194 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1061): Updates disabled for region observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:22,195 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] handler.CloseRegionHandler(125): Processing close of observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:22,195 INFO [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1119): Closed observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:22,196 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1039): Closing observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.: disabling compactions & flushes 2014-02-05 19:28:22,196 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1061): Updates disabled for region observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:22,196 INFO [StoreCloserThread-observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,198 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] handler.CloseRegionHandler(176): Closed observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:22,198 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(1123): Waiting on 4 regions to close 2014-02-05 19:28:22,198 DEBUG [RS:1;kiyo:60181] regionserver.HRegionServer(1127): {5b68e755b91897693a8ee58eae204d9d=observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d., b33b2590e622c698e6ba5ab3cb993387=observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387., 3df75a9a574dc10fbcdf4e5edf1f804a=observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a., fa6cfdf1d37cc487932219986736fcd7=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.} 2014-02-05 19:28:22,198 INFO [StoreCloserThread-observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,198 INFO [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1119): Closed observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:22,198 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] handler.CloseRegionHandler(125): Processing close of observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:22,199 INFO [RS_CLOSE_REGION-kiyo:60181-1] regionserver.HRegion(1119): Closed observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:22,199 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] handler.CloseRegionHandler(176): Closed observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:22,199 DEBUG [RS_CLOSE_REGION-kiyo:60181-1] handler.CloseRegionHandler(176): Closed observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:22,200 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] handler.CloseRegionHandler(125): Processing close of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:22,200 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1039): Closing observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.: disabling compactions & flushes 2014-02-05 19:28:22,200 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1061): Updates disabled for region observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:22,200 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1039): Closing observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.: disabling compactions & flushes 2014-02-05 19:28:22,201 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1061): Updates disabled for region observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:22,201 INFO [StoreCloserThread-observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,201 INFO [RS_CLOSE_REGION-kiyo:60181-0] regionserver.HRegion(1119): Closed observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:22,201 DEBUG [RS_CLOSE_REGION-kiyo:60181-0] handler.CloseRegionHandler(176): Closed observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:22,201 INFO [StoreCloserThread-observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:22,202 INFO [RS_CLOSE_REGION-kiyo:60181-2] regionserver.HRegion(1119): Closed observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:22,202 DEBUG [RS_CLOSE_REGION-kiyo:60181-2] handler.CloseRegionHandler(176): Closed observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:22,399 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(979): stopping server kiyo.gq1.ygridcore.net,60181,1391628487831; all regions closed. 2014-02-05 19:28:22,399 DEBUG [RS:1;kiyo:60181-WAL.AsyncNotifier] wal.FSHLog$AsyncNotifier(1332): RS:1;kiyo:60181-WAL.AsyncNotifier interrupted while waiting for notification from AsyncSyncer thread 2014-02-05 19:28:22,399 INFO [RS:1;kiyo:60181-WAL.AsyncNotifier] wal.FSHLog$AsyncNotifier(1337): RS:1;kiyo:60181-WAL.AsyncNotifier exiting 2014-02-05 19:28:22,400 DEBUG [RS:1;kiyo:60181-WAL.AsyncSyncer0] wal.FSHLog$AsyncSyncer(1278): RS:1;kiyo:60181-WAL.AsyncSyncer0 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:22,400 INFO [RS:1;kiyo:60181-WAL.AsyncSyncer0] wal.FSHLog$AsyncSyncer(1283): RS:1;kiyo:60181-WAL.AsyncSyncer0 exiting 2014-02-05 19:28:22,400 DEBUG [RS:1;kiyo:60181-WAL.AsyncSyncer1] wal.FSHLog$AsyncSyncer(1278): RS:1;kiyo:60181-WAL.AsyncSyncer1 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:22,400 INFO [RS:1;kiyo:60181-WAL.AsyncSyncer1] wal.FSHLog$AsyncSyncer(1283): RS:1;kiyo:60181-WAL.AsyncSyncer1 exiting 2014-02-05 19:28:22,400 DEBUG [RS:1;kiyo:60181-WAL.AsyncSyncer2] wal.FSHLog$AsyncSyncer(1278): RS:1;kiyo:60181-WAL.AsyncSyncer2 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:22,401 INFO [RS:1;kiyo:60181-WAL.AsyncSyncer2] wal.FSHLog$AsyncSyncer(1283): RS:1;kiyo:60181-WAL.AsyncSyncer2 exiting 2014-02-05 19:28:22,401 DEBUG [RS:1;kiyo:60181-WAL.AsyncSyncer3] wal.FSHLog$AsyncSyncer(1278): RS:1;kiyo:60181-WAL.AsyncSyncer3 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:22,401 INFO [RS:1;kiyo:60181-WAL.AsyncSyncer3] wal.FSHLog$AsyncSyncer(1283): RS:1;kiyo:60181-WAL.AsyncSyncer3 exiting 2014-02-05 19:28:22,401 DEBUG [RS:1;kiyo:60181-WAL.AsyncSyncer4] wal.FSHLog$AsyncSyncer(1278): RS:1;kiyo:60181-WAL.AsyncSyncer4 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:22,401 INFO [RS:1;kiyo:60181-WAL.AsyncSyncer4] wal.FSHLog$AsyncSyncer(1283): RS:1;kiyo:60181-WAL.AsyncSyncer4 exiting 2014-02-05 19:28:22,402 DEBUG [RS:1;kiyo:60181-WAL.AsyncWriter] wal.FSHLog$AsyncWriter(1153): RS:1;kiyo:60181-WAL.AsyncWriter interrupted while waiting for newer writes added to local buffer 2014-02-05 19:28:22,402 INFO [RS:1;kiyo:60181-WAL.AsyncWriter] wal.FSHLog$AsyncWriter(1158): RS:1;kiyo:60181-WAL.AsyncWriter exiting 2014-02-05 19:28:22,402 DEBUG [RS:1;kiyo:60181] wal.FSHLog(938): Closing WAL writer in hdfs://localhost:53087/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,542 INFO [RS:1;kiyo:60181] regionserver.Leases(147): RS:1;kiyo:60181 closing leases 2014-02-05 19:28:22,542 INFO [RS:1;kiyo:60181] regionserver.Leases(150): RS:1;kiyo:60181 closed leases 2014-02-05 19:28:22,543 INFO [RS:1;kiyo:60181] regionserver.CompactSplitThread(357): Waiting for Split Thread to finish... 2014-02-05 19:28:22,543 INFO [RS:1;kiyo:60181] regionserver.CompactSplitThread(357): Waiting for Merge Thread to finish... 2014-02-05 19:28:22,543 INFO [RS:1;kiyo:60181] regionserver.CompactSplitThread(357): Waiting for Large Compaction Thread to finish... 2014-02-05 19:28:22,543 INFO [RS:1;kiyo:60181] regionserver.CompactSplitThread(357): Waiting for Small Compaction Thread to finish... 2014-02-05 19:28:22,598 INFO [RS:1;kiyo:60181] client.HConnectionManager$HConnectionImplementation(1856): Closing zookeeper sessionid=0x144038588cb0007 2014-02-05 19:28:22,786 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,786 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,787 DEBUG [RS:1;kiyo:60181-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:60181-0x144038588cb0001, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-02-05 19:28:22,786 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,787 INFO [Thread-204-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [kiyo.gq1.ygridcore.net,60181,1391628487831] 2014-02-05 19:28:22,811 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(1011): stopping server kiyo.gq1.ygridcore.net,60181,1391628487831; zookeeper connection closed. 2014-02-05 19:28:22,811 INFO [RS:1;kiyo:60181] regionserver.HRegionServer(1014): RS:1;kiyo:60181 exiting 2014-02-05 19:28:22,811 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZKUtil(428): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:22,811 DEBUG [Thread-204-EventThread] master.AssignmentManager(3078): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,56349,1391628487792 server being checked: kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,812 INFO [RS:0;kiyo:56349-EventThread] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(119): /hbase/rs/kiyo.gq1.ygridcore.net,60181,1391628487831 znode expired, triggering replicatorRemoved event 2014-02-05 19:28:22,812 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7986e192] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(190): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7986e192 2014-02-05 19:28:22,814 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-02-05 19:28:22,814 DEBUG [Thread-204-EventThread] master.ServerManager(517): Added=kiyo.gq1.ygridcore.net,60181,1391628487831 to dead servers, submitted shutdown handler to be executed meta=false 2014-02-05 19:28:22,815 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-02-05 19:28:22,816 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZKUtil(428): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:22,816 DEBUG [Thread-204-EventThread] zookeeper.ZKUtil(428): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:22,817 DEBUG [Thread-204-EventThread] zookeeper.RegionServerTracker(91): RS node: /hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 data: PBUF� 2014-02-05 19:28:22,835 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] handler.ServerShutdownHandler(188): Splitting logs for kiyo.gq1.ygridcore.net,60181,1391628487831 before assignment. 2014-02-05 19:28:22,835 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] handler.ServerShutdownHandler(190): Mark regions in recovery before assignment. 2014-02-05 19:28:22,854 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/3df75a9a574dc10fbcdf4e5edf1f804a because node does not exist (not an error) 2014-02-05 19:28:22,925 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region 3df75a9a574dc10fbcdf4e5edf1f804a recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,926 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/1cad9af5f8ac68730058bdcee6114108 because node does not exist (not an error) 2014-02-05 19:28:22,967 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region 1cad9af5f8ac68730058bdcee6114108 recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:22,968 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/f6842668951720a44cfc14f734422d51 because node does not exist (not an error) 2014-02-05 19:28:23,143 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region f6842668951720a44cfc14f734422d51 recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,144 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/b33b2590e622c698e6ba5ab3cb993387 because node does not exist (not an error) 2014-02-05 19:28:23,439 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region b33b2590e622c698e6ba5ab3cb993387 recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,440 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/969db37065123ffec5eded7ad35041a6 because node does not exist (not an error) 2014-02-05 19:28:23,486 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region 969db37065123ffec5eded7ad35041a6 recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,487 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/5b68e755b91897693a8ee58eae204d9d because node does not exist (not an error) 2014-02-05 19:28:23,642 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region 5b68e755b91897693a8ee58eae204d9d recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,643 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/5d8421effa9ecd23359141f148ae1b66 because node does not exist (not an error) 2014-02-05 19:28:23,675 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region 5d8421effa9ecd23359141f148ae1b66 recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,676 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/ccabdaf5066a8b10de484bf12a2ef38f because node does not exist (not an error) 2014-02-05 19:28:23,712 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region ccabdaf5066a8b10de484bf12a2ef38f recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,713 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/eb1ecc76644cb50a62647f4c2ef4a612 because node does not exist (not an error) 2014-02-05 19:28:23,746 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region eb1ecc76644cb50a62647f4c2ef4a612 recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,746 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/fa6cfdf1d37cc487932219986736fcd7 because node does not exist (not an error) 2014-02-05 19:28:23,775 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region fa6cfdf1d37cc487932219986736fcd7 recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,776 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/d71919231008406bacce304f6ca7b653 because node does not exist (not an error) 2014-02-05 19:28:23,801 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region d71919231008406bacce304f6ca7b653 recovering from failed region server kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,802 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=OPEN, ts=1391628502031, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {d71919231008406bacce304f6ca7b653 state=OFFLINE, ts=1391628503802, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,802 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined d71919231008406bacce304f6ca7b653 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,803 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {44f008bd721ba7eaa0b08b382d743314 state=OPEN, ts=1391628496273, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {44f008bd721ba7eaa0b08b382d743314 state=OFFLINE, ts=1391628503803, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,803 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined 44f008bd721ba7eaa0b08b382d743314 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,803 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=OPEN, ts=1391628500255, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {ccabdaf5066a8b10de484bf12a2ef38f state=OFFLINE, ts=1391628503803, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,803 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined ccabdaf5066a8b10de484bf12a2ef38f from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,803 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {b33b2590e622c698e6ba5ab3cb993387 state=OPEN, ts=1391628498783, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {b33b2590e622c698e6ba5ab3cb993387 state=OFFLINE, ts=1391628503803, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,803 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined b33b2590e622c698e6ba5ab3cb993387 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,804 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=OPEN, ts=1391628499755, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {5d8421effa9ecd23359141f148ae1b66 state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,804 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined 5d8421effa9ecd23359141f148ae1b66 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,804 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=OPEN, ts=1391628500322, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {eb1ecc76644cb50a62647f4c2ef4a612 state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,804 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined eb1ecc76644cb50a62647f4c2ef4a612 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,804 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {3df75a9a574dc10fbcdf4e5edf1f804a state=OPEN, ts=1391628497189, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {3df75a9a574dc10fbcdf4e5edf1f804a state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,805 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined 3df75a9a574dc10fbcdf4e5edf1f804a from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,805 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=OPEN, ts=1391628501536, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {fa6cfdf1d37cc487932219986736fcd7 state=OFFLINE, ts=1391628503805, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,805 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined fa6cfdf1d37cc487932219986736fcd7 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,805 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {5b68e755b91897693a8ee58eae204d9d state=OPEN, ts=1391628499539, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {5b68e755b91897693a8ee58eae204d9d state=OFFLINE, ts=1391628503805, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,805 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined 5b68e755b91897693a8ee58eae204d9d from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,806 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {969db37065123ffec5eded7ad35041a6 state=OPEN, ts=1391628499698, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {969db37065123ffec5eded7ad35041a6 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,806 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined 969db37065123ffec5eded7ad35041a6 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,806 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {1cad9af5f8ac68730058bdcee6114108 state=OPEN, ts=1391628497725, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {1cad9af5f8ac68730058bdcee6114108 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,806 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined 1cad9af5f8ac68730058bdcee6114108 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,806 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {f6842668951720a44cfc14f734422d51 state=OPEN, ts=1391628498590, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {f6842668951720a44cfc14f734422d51 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831} 2014-02-05 19:28:23,806 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined f6842668951720a44cfc14f734422d51 from kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,807 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] handler.ServerShutdownHandler(210): Reassigning 11 region(s) that kiyo.gq1.ygridcore.net,60181,1391628487831 was carrying (and 0 regions(s) that were opening on this server) 2014-02-05 19:28:23,808 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1453): Assigning 11 region(s) to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,808 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node 3df75a9a574dc10fbcdf4e5edf1f804a with OFFLINE state 2014-02-05 19:28:23,808 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node 1cad9af5f8ac68730058bdcee6114108 with OFFLINE state 2014-02-05 19:28:23,809 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node f6842668951720a44cfc14f734422d51 with OFFLINE state 2014-02-05 19:28:23,809 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node b33b2590e622c698e6ba5ab3cb993387 with OFFLINE state 2014-02-05 19:28:23,809 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node 969db37065123ffec5eded7ad35041a6 with OFFLINE state 2014-02-05 19:28:23,810 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node 5b68e755b91897693a8ee58eae204d9d with OFFLINE state 2014-02-05 19:28:23,810 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node 5d8421effa9ecd23359141f148ae1b66 with OFFLINE state 2014-02-05 19:28:23,810 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node ccabdaf5066a8b10de484bf12a2ef38f with OFFLINE state 2014-02-05 19:28:23,811 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node eb1ecc76644cb50a62647f4c2ef4a612 with OFFLINE state 2014-02-05 19:28:23,811 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node fa6cfdf1d37cc487932219986736fcd7 with OFFLINE state 2014-02-05 19:28:23,811 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKAssign(175): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Async create of unassigned node d71919231008406bacce304f6ca7b653 with OFFLINE state 2014-02-05 19:28:23,825 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:23,825 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={3df75a9a574dc10fbcdf4e5edf1f804a state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,825 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={1cad9af5f8ac68730058bdcee6114108 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,890 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={f6842668951720a44cfc14f734422d51 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,890 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={b33b2590e622c698e6ba5ab3cb993387 state=OFFLINE, ts=1391628503803, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,891 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={969db37065123ffec5eded7ad35041a6 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,891 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={5b68e755b91897693a8ee58eae204d9d state=OFFLINE, ts=1391628503805, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,891 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={5d8421effa9ecd23359141f148ae1b66 state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,891 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={ccabdaf5066a8b10de484bf12a2ef38f state=OFFLINE, ts=1391628503803, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,891 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={eb1ecc76644cb50a62647f4c2ef4a612 state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,891 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={fa6cfdf1d37cc487932219986736fcd7 state=OFFLINE, ts=1391628503805, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback(69): rs={d71919231008406bacce304f6ca7b653 state=OFFLINE, ts=1391628503802, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={3df75a9a574dc10fbcdf4e5edf1f804a state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={1cad9af5f8ac68730058bdcee6114108 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={f6842668951720a44cfc14f734422d51 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={b33b2590e622c698e6ba5ab3cb993387 state=OFFLINE, ts=1391628503803, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={969db37065123ffec5eded7ad35041a6 state=OFFLINE, ts=1391628503806, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={5b68e755b91897693a8ee58eae204d9d state=OFFLINE, ts=1391628503805, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={5d8421effa9ecd23359141f148ae1b66 state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,892 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={ccabdaf5066a8b10de484bf12a2ef38f state=OFFLINE, ts=1391628503803, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,893 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={eb1ecc76644cb50a62647f4c2ef4a612 state=OFFLINE, ts=1391628503804, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,893 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={fa6cfdf1d37cc487932219986736fcd7 state=OFFLINE, ts=1391628503805, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,893 DEBUG [Thread-204-EventThread] master.OfflineCallback$ExistCallback(106): rs={d71919231008406bacce304f6ca7b653 state=OFFLINE, ts=1391628503802, server=kiyo.gq1.ygridcore.net,60181,1391628487831}, server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,894 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1504): kiyo.gq1.ygridcore.net,56349,1391628487792 unassigned znodes=11 of total=11 2014-02-05 19:28:23,894 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {3df75a9a574dc10fbcdf4e5edf1f804a state=OFFLINE, ts=1391628503808, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {3df75a9a574dc10fbcdf4e5edf1f804a state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,894 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {1cad9af5f8ac68730058bdcee6114108 state=OFFLINE, ts=1391628503808, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {1cad9af5f8ac68730058bdcee6114108 state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,894 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {f6842668951720a44cfc14f734422d51 state=OFFLINE, ts=1391628503809, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {f6842668951720a44cfc14f734422d51 state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,895 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {b33b2590e622c698e6ba5ab3cb993387 state=OFFLINE, ts=1391628503809, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {b33b2590e622c698e6ba5ab3cb993387 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,895 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {969db37065123ffec5eded7ad35041a6 state=OFFLINE, ts=1391628503809, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {969db37065123ffec5eded7ad35041a6 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,895 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {5b68e755b91897693a8ee58eae204d9d state=OFFLINE, ts=1391628503810, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {5b68e755b91897693a8ee58eae204d9d state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,895 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=OFFLINE, ts=1391628503810, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {5d8421effa9ecd23359141f148ae1b66 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,895 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=OFFLINE, ts=1391628503810, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {ccabdaf5066a8b10de484bf12a2ef38f state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,895 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=OFFLINE, ts=1391628503811, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {eb1ecc76644cb50a62647f4c2ef4a612 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,895 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=OFFLINE, ts=1391628503811, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {fa6cfdf1d37cc487932219986736fcd7 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,896 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=OFFLINE, ts=1391628503811, server=kiyo.gq1.ygridcore.net,60181,1391628487831} to {d71919231008406bacce304f6ca7b653 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,897 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:23,900 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:23,900 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 3df75a9a574dc10fbcdf4e5edf1f804a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:23,901 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:23,901 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 1cad9af5f8ac68730058bdcee6114108 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:23,902 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning f6842668951720a44cfc14f734422d51 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:23,902 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:23,912 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:23,912 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 3df75a9a574dc10fbcdf4e5edf1f804a from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:23,913 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:23,913 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(4366): Opening region: {ENCODED => 3df75a9a574dc10fbcdf4e5edf1f804a, NAME => 'observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.', STARTKEY => '', ENDKEY => 'bbb'} 2014-02-05 19:28:23,913 INFO [RS_OPEN_REGION-kiyo:56349-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:23,914 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:23,914 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(563): Instantiated observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:23,919 INFO [StoreOpener-3df75a9a574dc10fbcdf4e5edf1f804a-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:23,922 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:23,924 INFO [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(664): Onlined 3df75a9a574dc10fbcdf4e5edf1f804a; next sequenceid=40000001 2014-02-05 19:28:23,924 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:23,925 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:23,925 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 1cad9af5f8ac68730058bdcee6114108 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:23,925 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node f6842668951720a44cfc14f734422d51 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:23,925 DEBUG [AM.ZK.Worker-pool15-t15] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=3df75a9a574dc10fbcdf4e5edf1f804a, current_state={3df75a9a574dc10fbcdf4e5edf1f804a state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,925 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:23,926 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:23,926 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=1cad9af5f8ac68730058bdcee6114108, current_state={1cad9af5f8ac68730058bdcee6114108 state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,926 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(4366): Opening region: {ENCODED => 1cad9af5f8ac68730058bdcee6114108, NAME => 'observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.', STARTKEY => 'ddd', ENDKEY => 'eee'} 2014-02-05 19:28:23,926 INFO [PostOpenDeployTasks:3df75a9a574dc10fbcdf4e5edf1f804a] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:23,926 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(4366): Opening region: {ENCODED => f6842668951720a44cfc14f734422d51, NAME => 'observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.', STARTKEY => 'fff', ENDKEY => 'ggg'} 2014-02-05 19:28:23,927 DEBUG [AM.ZK.Worker-pool15-t13] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=f6842668951720a44cfc14f734422d51, current_state={f6842668951720a44cfc14f734422d51 state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,927 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:23,927 INFO [RS_OPEN_REGION-kiyo:56349-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:23,927 INFO [RS_OPEN_REGION-kiyo:56349-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:23,927 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:23,927 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table f6842668951720a44cfc14f734422d51 2014-02-05 19:28:23,928 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(563): Instantiated observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:23,928 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. 2014-02-05 19:28:23,928 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(563): Instantiated observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:23,929 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. 2014-02-05 19:28:23,933 INFO [StoreOpener-1cad9af5f8ac68730058bdcee6114108-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:23,933 INFO [StoreOpener-f6842668951720a44cfc14f734422d51-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:23,936 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:23,937 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:23,938 INFO [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(664): Onlined 1cad9af5f8ac68730058bdcee6114108; next sequenceid=40000001 2014-02-05 19:28:23,938 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:23,939 INFO [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(664): Onlined f6842668951720a44cfc14f734422d51; next sequenceid=40000001 2014-02-05 19:28:23,939 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node f6842668951720a44cfc14f734422d51 2014-02-05 19:28:23,942 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/recovering-regions/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:23,942 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. 2014-02-05 19:28:23,942 INFO [PostOpenDeployTasks:1cad9af5f8ac68730058bdcee6114108] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:23,945 INFO [PostOpenDeployTasks:f6842668951720a44cfc14f734422d51] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:23,954 DEBUG [PostOpenDeployTasks:3df75a9a574dc10fbcdf4e5edf1f804a] regionserver.HRegionServer(4518): Update last flushed sequence id of region 3df75a9a574dc10fbcdf4e5edf1f804a for kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,954 INFO [Priority.RpcServer.handler=2,port=56349] regionserver.HRegionServer(3594): Open observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. 2014-02-05 19:28:23,956 DEBUG [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1628): Bulk assigning done for kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,956 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {1cad9af5f8ac68730058bdcee6114108 state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {1cad9af5f8ac68730058bdcee6114108 state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,956 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2839): Waiting for 3df75a9a574dc10fbcdf4e5edf1f804a to leave regions-in-transition, timeOut=15000 ms. 2014-02-05 19:28:23,956 INFO [AM.ZK.Worker-pool15-t15] master.RegionStates(316): Transitioned {3df75a9a574dc10fbcdf4e5edf1f804a state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {3df75a9a574dc10fbcdf4e5edf1f804a state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,956 INFO [AM.ZK.Worker-pool15-t13] master.RegionStates(316): Transitioned {f6842668951720a44cfc14f734422d51 state=PENDING_OPEN, ts=1391628503894, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {f6842668951720a44cfc14f734422d51 state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:23,960 INFO [PostOpenDeployTasks:3df75a9a574dc10fbcdf4e5edf1f804a] catalog.MetaEditor(464): Updated row observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:23,960 INFO [PostOpenDeployTasks:3df75a9a574dc10fbcdf4e5edf1f804a] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:23,960 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 3df75a9a574dc10fbcdf4e5edf1f804a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:23,970 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/recovering-regions/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:23,995 DEBUG [PostOpenDeployTasks:1cad9af5f8ac68730058bdcee6114108] regionserver.HRegionServer(4518): Update last flushed sequence id of region 1cad9af5f8ac68730058bdcee6114108 for kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:23,995 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/recovering-regions/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:24,003 DEBUG [PostOpenDeployTasks:f6842668951720a44cfc14f734422d51] regionserver.HRegionServer(4518): Update last flushed sequence id of region f6842668951720a44cfc14f734422d51 for kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:24,004 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:24,004 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 3df75a9a574dc10fbcdf4e5edf1f804a from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,004 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(379): Transitioned 3df75a9a574dc10fbcdf4e5edf1f804a to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,004 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(179): Opened observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,004 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning b33b2590e622c698e6ba5ab3cb993387 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:24,005 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=3df75a9a574dc10fbcdf4e5edf1f804a, current_state={3df75a9a574dc10fbcdf4e5edf1f804a state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,005 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(316): Transitioned {3df75a9a574dc10fbcdf4e5edf1f804a state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {3df75a9a574dc10fbcdf4e5edf1f804a state=OPEN, ts=1391628504005, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,005 DEBUG [AM.ZK.Worker-pool15-t19] handler.OpenedRegionHandler(149): Handling OPENED of 3df75a9a574dc10fbcdf4e5edf1f804a from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:24,009 INFO [PostOpenDeployTasks:1cad9af5f8ac68730058bdcee6114108] catalog.MetaEditor(464): Updated row observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,010 INFO [PostOpenDeployTasks:1cad9af5f8ac68730058bdcee6114108] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:24,010 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 1cad9af5f8ac68730058bdcee6114108 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,010 INFO [PostOpenDeployTasks:f6842668951720a44cfc14f734422d51] catalog.MetaEditor(464): Updated row observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,010 INFO [PostOpenDeployTasks:f6842668951720a44cfc14f734422d51] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:24,010 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning f6842668951720a44cfc14f734422d51 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,068 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:24,068 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node b33b2590e622c698e6ba5ab3cb993387 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:24,069 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(4366): Opening region: {ENCODED => b33b2590e622c698e6ba5ab3cb993387, NAME => 'observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.', STARTKEY => 'iii', ENDKEY => 'jjj'} 2014-02-05 19:28:24,069 INFO [RS_OPEN_REGION-kiyo:56349-1] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:24,069 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:24,070 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(563): Instantiated observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:24,074 INFO [StoreOpener-b33b2590e622c698e6ba5ab3cb993387-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:24,076 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:24,077 INFO [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(664): Onlined b33b2590e622c698e6ba5ab3cb993387; next sequenceid=40000001 2014-02-05 19:28:24,078 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:24,087 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/3df75a9a574dc10fbcdf4e5edf1f804a 2014-02-05 19:28:24,087 DEBUG [AM.ZK.Worker-pool15-t19] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 3df75a9a574dc10fbcdf4e5edf1f804a in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:24,087 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:24,087 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=b33b2590e622c698e6ba5ab3cb993387, current_state={b33b2590e622c698e6ba5ab3cb993387 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,087 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager$4(1175): Znode observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. deleted, state: {3df75a9a574dc10fbcdf4e5edf1f804a state=OPEN, ts=1391628504005, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,087 INFO [AM.ZK.Worker-pool15-t18] master.RegionStates(316): Transitioned {b33b2590e622c698e6ba5ab3cb993387 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {b33b2590e622c698e6ba5ab3cb993387 state=OPENING, ts=1391628504087, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,088 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(377): Onlined 3df75a9a574dc10fbcdf4e5edf1f804a on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,088 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2839): Waiting for 1cad9af5f8ac68730058bdcee6114108 to leave regions-in-transition, timeOut=15000 ms. 2014-02-05 19:28:24,111 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:24,111 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 1cad9af5f8ac68730058bdcee6114108 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,111 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:24,111 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node f6842668951720a44cfc14f734422d51 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,111 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(379): Transitioned f6842668951720a44cfc14f734422d51 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,111 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(379): Transitioned 1cad9af5f8ac68730058bdcee6114108 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,111 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(179): Opened observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,111 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(179): Opened observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,112 DEBUG [AM.ZK.Worker-pool15-t20] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=1cad9af5f8ac68730058bdcee6114108, current_state={1cad9af5f8ac68730058bdcee6114108 state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,112 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 5b68e755b91897693a8ee58eae204d9d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:24,112 INFO [AM.ZK.Worker-pool15-t20] master.RegionStates(316): Transitioned {1cad9af5f8ac68730058bdcee6114108 state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {1cad9af5f8ac68730058bdcee6114108 state=OPEN, ts=1391628504112, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,112 DEBUG [AM.ZK.Worker-pool15-t20] handler.OpenedRegionHandler(149): Handling OPENED of 1cad9af5f8ac68730058bdcee6114108 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:24,112 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=f6842668951720a44cfc14f734422d51, current_state={f6842668951720a44cfc14f734422d51 state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,112 INFO [PostOpenDeployTasks:b33b2590e622c698e6ba5ab3cb993387] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:24,112 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 969db37065123ffec5eded7ad35041a6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:24,113 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(316): Transitioned {f6842668951720a44cfc14f734422d51 state=OPENING, ts=1391628503956, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {f6842668951720a44cfc14f734422d51 state=OPEN, ts=1391628504113, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,113 DEBUG [AM.ZK.Worker-pool15-t1] handler.OpenedRegionHandler(149): Handling OPENED of f6842668951720a44cfc14f734422d51 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:24,176 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 5b68e755b91897693a8ee58eae204d9d from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:24,177 DEBUG [AM.ZK.Worker-pool15-t20] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 1cad9af5f8ac68730058bdcee6114108 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:24,177 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:24,177 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(4366): Opening region: {ENCODED => 5b68e755b91897693a8ee58eae204d9d, NAME => 'observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.', STARTKEY => 'nnn', ENDKEY => 'ooo'} 2014-02-05 19:28:24,177 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1cad9af5f8ac68730058bdcee6114108 2014-02-05 19:28:24,177 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:24,177 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager$4(1175): Znode observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. deleted, state: {1cad9af5f8ac68730058bdcee6114108 state=OPEN, ts=1391628504112, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,178 INFO [AM.ZK.Worker-pool15-t7] master.RegionStates(377): Onlined 1cad9af5f8ac68730058bdcee6114108 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,178 INFO [RS_OPEN_REGION-kiyo:56349-0] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:24,178 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2839): Waiting for f6842668951720a44cfc14f734422d51 to leave regions-in-transition, timeOut=15000 ms. 2014-02-05 19:28:24,178 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:24,178 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(563): Instantiated observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:24,183 INFO [StoreOpener-5b68e755b91897693a8ee58eae204d9d-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:24,187 DEBUG [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:24,188 INFO [RS_OPEN_REGION-kiyo:56349-0] regionserver.HRegion(664): Onlined 5b68e755b91897693a8ee58eae204d9d; next sequenceid=40000001 2014-02-05 19:28:24,189 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:24,210 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:24,210 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 969db37065123ffec5eded7ad35041a6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:24,210 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(4366): Opening region: {ENCODED => 969db37065123ffec5eded7ad35041a6, NAME => 'observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.', STARTKEY => 'mmm', ENDKEY => 'nnn'} 2014-02-05 19:28:24,211 INFO [RS_OPEN_REGION-kiyo:56349-2] coprocessor.CoprocessorHost(165): System coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver was loaded successfully with priority (536870911). 2014-02-05 19:28:24,211 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:24,212 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(563): Instantiated observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:24,216 INFO [StoreOpener-969db37065123ffec5eded7ad35041a6-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:24,219 DEBUG [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:24,220 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/f6842668951720a44cfc14f734422d51 2014-02-05 19:28:24,220 DEBUG [AM.ZK.Worker-pool15-t1] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node f6842668951720a44cfc14f734422d51 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:24,220 DEBUG [AM.ZK.Worker-pool15-t6] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=5b68e755b91897693a8ee58eae204d9d, current_state={5b68e755b91897693a8ee58eae204d9d state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,220 DEBUG [AM.ZK.Worker-pool15-t1] master.AssignmentManager$4(1175): Znode observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. deleted, state: {f6842668951720a44cfc14f734422d51 state=OPEN, ts=1391628504113, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,221 INFO [AM.ZK.Worker-pool15-t6] master.RegionStates(316): Transitioned {5b68e755b91897693a8ee58eae204d9d state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {5b68e755b91897693a8ee58eae204d9d state=OPENING, ts=1391628504221, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,221 DEBUG [AM.ZK.Worker-pool15-t10] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=969db37065123ffec5eded7ad35041a6, current_state={969db37065123ffec5eded7ad35041a6 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,221 INFO [AM.ZK.Worker-pool15-t1] master.RegionStates(377): Onlined f6842668951720a44cfc14f734422d51 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,221 INFO [RS_OPEN_REGION-kiyo:56349-2] regionserver.HRegion(664): Onlined 969db37065123ffec5eded7ad35041a6; next sequenceid=40000001 2014-02-05 19:28:24,221 INFO [AM.ZK.Worker-pool15-t10] master.RegionStates(316): Transitioned {969db37065123ffec5eded7ad35041a6 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {969db37065123ffec5eded7ad35041a6 state=OPENING, ts=1391628504221, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,221 INFO [PostOpenDeployTasks:5b68e755b91897693a8ee58eae204d9d] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:24,221 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2839): Waiting for b33b2590e622c698e6ba5ab3cb993387 to leave regions-in-transition, timeOut=15000 ms. 2014-02-05 19:28:24,221 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:24,252 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/recovering-regions/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:24,253 INFO [PostOpenDeployTasks:969db37065123ffec5eded7ad35041a6] regionserver.HRegionServer(1748): Post open deploy tasks for region=observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:24,435 DEBUG [PostOpenDeployTasks:b33b2590e622c698e6ba5ab3cb993387] regionserver.HRegionServer(4518): Update last flushed sequence id of region b33b2590e622c698e6ba5ab3cb993387 for kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:24,526 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/recovering-regions/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:24,634 DEBUG [PostOpenDeployTasks:5b68e755b91897693a8ee58eae204d9d] regionserver.HRegionServer(4518): Update last flushed sequence id of region 5b68e755b91897693a8ee58eae204d9d for kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:24,638 INFO [PostOpenDeployTasks:b33b2590e622c698e6ba5ab3cb993387] catalog.MetaEditor(464): Updated row observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,639 INFO [PostOpenDeployTasks:b33b2590e622c698e6ba5ab3cb993387] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:24,639 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning b33b2590e622c698e6ba5ab3cb993387 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,659 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/recovering-regions/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:24,675 DEBUG [PostOpenDeployTasks:969db37065123ffec5eded7ad35041a6] regionserver.HRegionServer(4518): Update last flushed sequence id of region 969db37065123ffec5eded7ad35041a6 for kiyo.gq1.ygridcore.net,60181,1391628487831 2014-02-05 19:28:24,680 INFO [PostOpenDeployTasks:5b68e755b91897693a8ee58eae204d9d] catalog.MetaEditor(464): Updated row observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,680 INFO [PostOpenDeployTasks:5b68e755b91897693a8ee58eae204d9d] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:24,680 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 5b68e755b91897693a8ee58eae204d9d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,701 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:24,701 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node b33b2590e622c698e6ba5ab3cb993387 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,701 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(379): Transitioned b33b2590e622c698e6ba5ab3cb993387 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,701 DEBUG [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(179): Opened observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,701 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 5d8421effa9ecd23359141f148ae1b66 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:24,702 DEBUG [AM.ZK.Worker-pool15-t9] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=b33b2590e622c698e6ba5ab3cb993387, current_state={b33b2590e622c698e6ba5ab3cb993387 state=OPENING, ts=1391628504087, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,702 INFO [AM.ZK.Worker-pool15-t9] master.RegionStates(316): Transitioned {b33b2590e622c698e6ba5ab3cb993387 state=OPENING, ts=1391628504087, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {b33b2590e622c698e6ba5ab3cb993387 state=OPEN, ts=1391628504702, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,702 DEBUG [AM.ZK.Worker-pool15-t9] handler.OpenedRegionHandler(149): Handling OPENED of b33b2590e622c698e6ba5ab3cb993387 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:24,706 INFO [PostOpenDeployTasks:969db37065123ffec5eded7ad35041a6] catalog.MetaEditor(464): Updated row observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. with server=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,706 INFO [PostOpenDeployTasks:969db37065123ffec5eded7ad35041a6] regionserver.HRegionServer(1773): Finished post open deploy task for observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:24,706 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 969db37065123ffec5eded7ad35041a6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,711 ERROR [RpcServer.handler=0,port=56349] coprocessor.CoprocessorHost(760): The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception java.lang.NullPointerException at org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver.prePut(TestRegionServerCoprocessorExceptionWithAbort.java:160) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:1122) at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:2161) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2136) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2092) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2096) at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4200) at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3441) at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3345) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28460) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,712 FATAL [RpcServer.handler=0,port=56349] regionserver.HRegionServer(1796): ABORTING region server kiyo.gq1.ygridcore.net,56349,1391628487792: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception java.lang.NullPointerException at org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver.prePut(TestRegionServerCoprocessorExceptionWithAbort.java:160) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:1122) at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:2161) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2136) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2092) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2096) at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4200) at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3441) at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3345) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28460) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,713 FATAL [RpcServer.handler=0,port=56349] regionserver.HRegionServer(1804): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint, org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver] 2014-02-05 19:28:24,715 ERROR [FifoRpcScheduler.handler5-thread-3] master.HMaster(1359): Region server kiyo.gq1.ygridcore.net,56349,1391628487792 reported a fatal error: ABORTING region server kiyo.gq1.ygridcore.net,56349,1391628487792: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception Cause: java.lang.NullPointerException at org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver.prePut(TestRegionServerCoprocessorExceptionWithAbort.java:160) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:1122) at org.apache.hadoop.hbase.regionserver.HRegion.doPreMutationHook(HRegion.java:2161) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2136) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2092) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2096) at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4200) at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3441) at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3345) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28460) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,716 INFO [RpcServer.handler=0,port=56349] regionserver.HRegionServer(1730): STOPPED: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception 2014-02-05 19:28:24,717 DEBUG [RpcServer.handler=0,port=56349] wal.FSHLog(1360): interrupted while waiting for notification from AsyncNotifier 2014-02-05 19:28:24,717 INFO [RS:0;kiyo:56349] regionserver.SplitLogWorker(606): Sending interrupt to stop the worker thread 2014-02-05 19:28:24,721 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(914): Stopping infoServer 2014-02-05 19:28:24,721 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,56349,1391628487792] regionserver.SplitLogWorker(297): SplitLogWorker interrupted while waiting for task, exiting: java.lang.InterruptedException 2014-02-05 19:28:24,721 INFO [SplitLogWorker-kiyo.gq1.ygridcore.net,56349,1391628487792] regionserver.SplitLogWorker(214): SplitLogWorker kiyo.gq1.ygridcore.net,56349,1391628487792 exiting 2014-02-05 19:28:24,723 INFO [RS:0;kiyo:56349] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-02-05 19:28:24,725 WARN [RpcServer.handler=0,port=56349] ipc.RpcServer$Responder(1041): RpcServer.respondercallId: 166 service: ClientService methodName: Multi size: 139.0 connection: 68.142.244.61:49072: output error 2014-02-05 19:28:24,726 WARN [RpcServer.handler=0,port=56349] ipc.CallRunner(129): RpcServer.handler=0,port=56349: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null 2014-02-05 19:28:24,727 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:24,727 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 5b68e755b91897693a8ee58eae204d9d from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,727 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(379): Transitioned 5b68e755b91897693a8ee58eae204d9d to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,728 DEBUG [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(179): Opened observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,728 INFO [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(436): Opening of region {ENCODED => ccabdaf5066a8b10de484bf12a2ef38f, NAME => 'observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.', STARTKEY => 'sss', ENDKEY => 'ttt'} failed, transitioning from OFFLINE to FAILED_OPEN in ZK, expecting version 0 2014-02-05 19:28:24,728 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning ccabdaf5066a8b10de484bf12a2ef38f from M_ZK_REGION_OFFLINE to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,728 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=5b68e755b91897693a8ee58eae204d9d, current_state={5b68e755b91897693a8ee58eae204d9d state=OPENING, ts=1391628504221, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,729 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(316): Transitioned {5b68e755b91897693a8ee58eae204d9d state=OPENING, ts=1391628504221, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {5b68e755b91897693a8ee58eae204d9d state=OPEN, ts=1391628504729, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,729 DEBUG [AM.ZK.Worker-pool15-t8] handler.OpenedRegionHandler(149): Handling OPENED of 5b68e755b91897693a8ee58eae204d9d from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:24,751 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:24,751 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 5d8421effa9ecd23359141f148ae1b66 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-02-05 19:28:24,751 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(4366): Opening region: {ENCODED => 5d8421effa9ecd23359141f148ae1b66, NAME => 'observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.', STARTKEY => 'ppp', ENDKEY => 'qqq'} 2014-02-05 19:28:24,752 ERROR [RS_OPEN_REGION-kiyo:56349-1] coprocessor.CoprocessorHost(760): The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception org.apache.hadoop.hbase.regionserver.LeaseException: lease 'x' does not exist at org.apache.hadoop.hbase.regionserver.Leases.removeLease(Leases.java:221) at org.apache.hadoop.hbase.regionserver.Leases.cancelLease(Leases.java:206) at org.apache.hadoop.hbase.coprocessor.SimpleRegionObserver.start(SimpleRegionObserver.java:140) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$Environment.startup(CoprocessorHost.java:651) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadInstance(CoprocessorHost.java:261) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:164) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.(RegionCoprocessorHost.java:155) at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:547) at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:454) at sun.reflect.GeneratedConstructorAccessor26.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:4057) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4368) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4341) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4297) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4248) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:465) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:139) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,753 FATAL [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegionServer(1796): ABORTING region server kiyo.gq1.ygridcore.net,56349,1391628487792: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception org.apache.hadoop.hbase.regionserver.LeaseException: lease 'x' does not exist at org.apache.hadoop.hbase.regionserver.Leases.removeLease(Leases.java:221) at org.apache.hadoop.hbase.regionserver.Leases.cancelLease(Leases.java:206) at org.apache.hadoop.hbase.coprocessor.SimpleRegionObserver.start(SimpleRegionObserver.java:140) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$Environment.startup(CoprocessorHost.java:651) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadInstance(CoprocessorHost.java:261) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:164) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.(RegionCoprocessorHost.java:155) at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:547) at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:454) at sun.reflect.GeneratedConstructorAccessor26.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:4057) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4368) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4341) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4297) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4248) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:465) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:139) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,753 FATAL [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegionServer(1804): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint, org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver] 2014-02-05 19:28:24,754 ERROR [FifoRpcScheduler.handler5-thread-5] master.HMaster(1359): Region server kiyo.gq1.ygridcore.net,56349,1391628487792 reported a fatal error: ABORTING region server kiyo.gq1.ygridcore.net,56349,1391628487792: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception Cause: org.apache.hadoop.hbase.regionserver.LeaseException: lease 'x' does not exist at org.apache.hadoop.hbase.regionserver.Leases.removeLease(Leases.java:221) at org.apache.hadoop.hbase.regionserver.Leases.cancelLease(Leases.java:206) at org.apache.hadoop.hbase.coprocessor.SimpleRegionObserver.start(SimpleRegionObserver.java:140) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$Environment.startup(CoprocessorHost.java:651) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadInstance(CoprocessorHost.java:261) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:164) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.(RegionCoprocessorHost.java:155) at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:547) at org.apache.hadoop.hbase.regionserver.HRegion.(HRegion.java:454) at sun.reflect.GeneratedConstructorAccessor26.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:4057) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4368) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4341) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4297) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4248) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:465) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:139) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,755 INFO [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegionServer(1730): STOPPED: The coprocessor org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort$BuggyRegionObserver threw an unexpected exception 2014-02-05 19:28:24,755 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.MetricsRegionSourceImpl(58): Creating new MetricsRegionSourceImpl for table observed_table 5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:24,755 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(563): Instantiated observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:24,761 INFO [StoreOpener-5d8421effa9ecd23359141f148ae1b66-1] compactions.CompactionConfiguration(88): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000 2014-02-05 19:28:24,764 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(3021): Found 0 recovered edits file(s) under hdfs://localhost:53087/user/hortonzy/hbase/data/default/observed_table/5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:24,766 INFO [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(664): Onlined 5d8421effa9ecd23359141f148ae1b66; next sequenceid=40000001 2014-02-05 19:28:24,766 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(644): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Attempting to retransition opening state of node 5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:24,770 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/b33b2590e622c698e6ba5ab3cb993387 2014-02-05 19:28:24,770 DEBUG [AM.ZK.Worker-pool15-t9] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node b33b2590e622c698e6ba5ab3cb993387 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:24,770 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:24,770 DEBUG [AM.ZK.Worker-pool15-t9] master.AssignmentManager$4(1175): Znode observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. deleted, state: {b33b2590e622c698e6ba5ab3cb993387 state=OPEN, ts=1391628504702, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,770 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:24,770 INFO [AM.ZK.Worker-pool15-t9] master.RegionStates(377): Onlined b33b2590e622c698e6ba5ab3cb993387 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,770 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 969db37065123ffec5eded7ad35041a6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-02-05 19:28:24,771 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2839): Waiting for 969db37065123ffec5eded7ad35041a6 to leave regions-in-transition, timeOut=15000 ms. 2014-02-05 19:28:24,771 DEBUG [AM.ZK.Worker-pool15-t16] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENING, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=5d8421effa9ecd23359141f148ae1b66, current_state={5d8421effa9ecd23359141f148ae1b66 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,771 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.: disabling compactions & flushes 2014-02-05 19:28:24,771 INFO [AM.ZK.Worker-pool15-t16] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {5d8421effa9ecd23359141f148ae1b66 state=OPENING, ts=1391628504771, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,771 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(379): Transitioned 969db37065123ffec5eded7ad35041a6 to OPENED in zk on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,771 DEBUG [RS_OPEN_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. 2014-02-05 19:28:24,772 DEBUG [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(179): Opened observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,772 INFO [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(399): Opening of region {ENCODED => 5d8421effa9ecd23359141f148ae1b66, NAME => 'observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.', STARTKEY => 'ppp', ENDKEY => 'qqq'} failed, transitioning from OPENING to FAILED_OPEN in ZK, expecting version 1 2014-02-05 19:28:24,772 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning 5d8421effa9ecd23359141f148ae1b66 from RS_ZK_REGION_OPENING to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,772 INFO [RS_OPEN_REGION-kiyo:56349-2] handler.OpenRegionHandler(436): Opening of region {ENCODED => eb1ecc76644cb50a62647f4c2ef4a612, NAME => 'observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.', STARTKEY => 'ttt', ENDKEY => 'uuu'} failed, transitioning from OFFLINE to FAILED_OPEN in ZK, expecting version 0 2014-02-05 19:28:24,773 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning eb1ecc76644cb50a62647f4c2ef4a612 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,778 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:24,778 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node ccabdaf5066a8b10de484bf12a2ef38f from M_ZK_REGION_OFFLINE to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,778 INFO [RS_OPEN_REGION-kiyo:56349-0] handler.OpenRegionHandler(436): Opening of region {ENCODED => fa6cfdf1d37cc487932219986736fcd7, NAME => 'observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.', STARTKEY => 'vvv', ENDKEY => 'www'} failed, transitioning from OFFLINE to FAILED_OPEN in ZK, expecting version 0 2014-02-05 19:28:24,778 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning fa6cfdf1d37cc487932219986736fcd7 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,778 DEBUG [AM.ZK.Worker-pool15-t12] master.AssignmentManager(790): Handling RS_ZK_REGION_OPENED, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=969db37065123ffec5eded7ad35041a6, current_state={969db37065123ffec5eded7ad35041a6 state=OPENING, ts=1391628504221, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,778 INFO [AM.ZK.Worker-pool15-t12] master.RegionStates(316): Transitioned {969db37065123ffec5eded7ad35041a6 state=OPENING, ts=1391628504221, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {969db37065123ffec5eded7ad35041a6 state=OPEN, ts=1391628504778, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,779 DEBUG [AM.ZK.Worker-pool15-t12] handler.OpenedRegionHandler(149): Handling OPENED of 969db37065123ffec5eded7ad35041a6 from kiyo.gq1.ygridcore.net,56349,1391628487792; deleting unassigned node 2014-02-05 19:28:24,827 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/5b68e755b91897693a8ee58eae204d9d 2014-02-05 19:28:24,827 DEBUG [AM.ZK.Worker-pool15-t8] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 5b68e755b91897693a8ee58eae204d9d in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:24,827 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:24,828 DEBUG [AM.ZK.Worker-pool15-t8] master.AssignmentManager$4(1175): Znode observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. deleted, state: {5b68e755b91897693a8ee58eae204d9d state=OPEN, ts=1391628504729, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,828 INFO [AM.ZK.Worker-pool15-t8] master.RegionStates(377): Onlined 5b68e755b91897693a8ee58eae204d9d on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,828 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(790): Handling RS_ZK_REGION_FAILED_OPEN, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=ccabdaf5066a8b10de484bf12a2ef38f, current_state={ccabdaf5066a8b10de484bf12a2ef38f state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,828 INFO [RS_OPEN_META-kiyo:56349-0-MetaLogRoller] regionserver.LogRoller(120): LogRoller exiting. 2014-02-05 19:28:24,829 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {ccabdaf5066a8b10de484bf12a2ef38f state=CLOSED, ts=1391628504829, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,829 INFO [RS:0;kiyo:56349.nonceCleaner] hbase.Chore(93): RS:0;kiyo:56349.nonceCleaner exiting 2014-02-05 19:28:24,828 INFO [RS:0;kiyo:56349.logRoller] regionserver.LogRoller(120): LogRoller exiting. 2014-02-05 19:28:24,828 INFO [Thread-331] regionserver.MemStoreFlusher$FlushHandler(269): Thread-331 exiting 2014-02-05 19:28:24,828 INFO [RS:0;kiyo:56349.compactionChecker] hbase.Chore(93): RS:0;kiyo:56349.compactionChecker exiting 2014-02-05 19:28:24,828 INFO [RS:0;kiyo:56349] snapshot.RegionServerSnapshotManager(152): Stopping RegionServerSnapshotManager abruptly. 2014-02-05 19:28:24,829 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2140): Can't move ccabdaf5066a8b10de484bf12a2ef38f, there is no destination server available. 2014-02-05 19:28:24,830 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(125): Processing close of observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:24,830 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(125): Processing close of hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:24,831 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1039): Closing observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.: disabling compactions & flushes 2014-02-05 19:28:24,831 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(125): Processing close of observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:24,832 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7.: disabling compactions & flushes 2014-02-05 19:28:24,831 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1061): Updates disabled for region observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:24,832 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:24,832 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1039): Closing observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d.: disabling compactions & flushes 2014-02-05 19:28:24,833 DEBUG [AM.ZK.Worker-pool15-t11] handler.ClosedRegionHandler(92): Handling CLOSED event for ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:24,833 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1061): Updates disabled for region observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:24,833 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,833 INFO [StoreCloserThread-hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7.-1] regionserver.HStore(740): Closed info 2014-02-05 19:28:24,833 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(956): aborting server kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,833 INFO [StoreCloserThread-observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,834 INFO [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1119): Closed hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:24,834 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(176): Closed hbase:namespace,,1391628492516.e513fb0093c1f4c7b2598886cb3542b7. 2014-02-05 19:28:24,834 INFO [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1119): Closed observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:24,834 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(125): Processing close of observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:24,834 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(176): Closed observed_table,ooo,1391628496454.4c5ec8b18f78d5d6c16c30f630223c3d. 2014-02-05 19:28:24,834 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(125): Processing close of observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:24,835 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71.: disabling compactions & flushes 2014-02-05 19:28:24,833 DEBUG [RS:0;kiyo:56349] catalog.CatalogTracker(210): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@16970e60 2014-02-05 19:28:24,835 INFO [RS:0;kiyo:56349] client.HConnectionManager$HConnectionImplementation(1856): Closing zookeeper sessionid=0x144038588cb0004 2014-02-05 19:28:24,833 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2192): Using pre-existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=kiyo.gq1.ygridcore.net,60181,1391628487831, dest=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,835 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=CLOSED, ts=1391628504833, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {ccabdaf5066a8b10de484bf12a2ef38f state=OFFLINE, ts=1391628504835, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,836 DEBUG [AM.ZK.Worker-pool15-t11] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node ccabdaf5066a8b10de484bf12a2ef38f with OFFLINE state 2014-02-05 19:28:24,833 INFO [StoreCloserThread-observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,835 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:24,835 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1039): Closing observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.: disabling compactions & flushes 2014-02-05 19:28:24,836 INFO [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1119): Closed observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:24,836 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(176): Closed observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. 2014-02-05 19:28:24,837 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(125): Processing close of observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:24,836 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1061): Updates disabled for region observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:24,838 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1039): Closing observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94.: disabling compactions & flushes 2014-02-05 19:28:24,836 INFO [StoreCloserThread-observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,839 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1061): Updates disabled for region observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:24,839 INFO [StoreCloserThread-observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,839 INFO [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1119): Closed observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:24,839 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(176): Closed observed_table,hhh,1391628496418.bc4d57d6d26dbf95cc733d4423dfcf71. 2014-02-05 19:28:24,839 INFO [StoreCloserThread-observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,839 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(125): Processing close of observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:24,839 INFO [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1119): Closed observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:24,840 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c.: disabling compactions & flushes 2014-02-05 19:28:24,840 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(176): Closed observed_table,fff,1391628496407.f6842668951720a44cfc14f734422d51. 2014-02-05 19:28:24,840 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:24,840 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(125): Processing close of observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:24,840 INFO [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1119): Closed observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:24,841 INFO [StoreCloserThread-observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,841 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(176): Closed observed_table,ggg,1391628496412.9011eccd5484e8045dd3e70898d03e94. 2014-02-05 19:28:24,840 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1039): Closing observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041.: disabling compactions & flushes 2014-02-05 19:28:24,841 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1061): Updates disabled for region observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:24,841 INFO [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1119): Closed observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:24,841 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(125): Processing close of observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:24,842 INFO [StoreCloserThread-observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,842 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(176): Closed observed_table,rrr,1391628496469.ff2b57089c32fcf1c14e7fc68c98400c. 2014-02-05 19:28:24,842 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1039): Closing observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086.: disabling compactions & flushes 2014-02-05 19:28:24,842 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(125): Processing close of observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:24,842 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1061): Updates disabled for region observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:24,842 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7.: disabling compactions & flushes 2014-02-05 19:28:24,843 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:24,842 INFO [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1119): Closed observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:24,843 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(176): Closed observed_table,jjj,1391628496428.740d8ee103ea2c47a0694af96bbf1041. 2014-02-05 19:28:24,843 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(125): Processing close of observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:24,843 INFO [StoreCloserThread-observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,843 INFO [StoreCloserThread-observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,843 INFO [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1119): Closed observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:24,844 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(176): Closed observed_table,qqq,1391628496464.48619aa07760528441dedb46a46e4086. 2014-02-05 19:28:24,843 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1039): Closing observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.: disabling compactions & flushes 2014-02-05 19:28:24,844 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(125): Processing close of observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:24,844 INFO [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1119): Closed observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:24,844 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1039): Closing observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804.: disabling compactions & flushes 2014-02-05 19:28:24,844 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(176): Closed observed_table,uuu,1391628496484.1735b9d68af9b230db1e07759f36e2f7. 2014-02-05 19:28:24,844 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1061): Updates disabled for region observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:24,844 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(125): Processing close of observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:24,844 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1061): Updates disabled for region observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:24,845 INFO [StoreCloserThread-observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,845 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing observed_table,bbb,1391628496385.a9404de25502388bb384642862829808.: disabling compactions & flushes 2014-02-05 19:28:24,845 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:24,845 INFO [StoreCloserThread-observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,845 INFO [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1119): Closed observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:24,846 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(176): Closed observed_table,kkk,1391628496434.40eb44f442967c47f644d3a0dc1b4804. 2014-02-05 19:28:24,846 INFO [StoreCloserThread-observed_table,bbb,1391628496385.a9404de25502388bb384642862829808.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,846 INFO [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1119): Closed observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:24,846 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(176): Closed observed_table,ddd,1391628496396.1cad9af5f8ac68730058bdcee6114108. 2014-02-05 19:28:24,846 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(125): Processing close of observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:24,846 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(125): Processing close of observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:24,847 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1039): Closing observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6.: disabling compactions & flushes 2014-02-05 19:28:24,847 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1039): Closing observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71.: disabling compactions & flushes 2014-02-05 19:28:24,847 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1061): Updates disabled for region observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:24,847 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1061): Updates disabled for region observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:24,846 INFO [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1119): Closed observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:24,847 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(176): Closed observed_table,bbb,1391628496385.a9404de25502388bb384642862829808. 2014-02-05 19:28:24,848 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(125): Processing close of observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:24,848 INFO [StoreCloserThread-observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,848 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d.: disabling compactions & flushes 2014-02-05 19:28:24,848 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:24,848 INFO [StoreCloserThread-observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,848 INFO [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1119): Closed observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:24,849 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(176): Closed observed_table,lll,1391628496439.25ede678d83c1f7baa61b657a6f5c7a6. 2014-02-05 19:28:24,849 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(125): Processing close of observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:24,849 INFO [StoreCloserThread-observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,849 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1039): Closing observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.: disabling compactions & flushes 2014-02-05 19:28:24,849 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1061): Updates disabled for region observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:24,849 INFO [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1119): Closed observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:24,849 INFO [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1119): Closed observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:24,850 INFO [StoreCloserThread-observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,850 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(176): Closed observed_table,www,1391628496494.3c3390359fda1872fb2cecc76cfc3f71. 2014-02-05 19:28:24,849 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(176): Closed observed_table,xxx,1391628496499.fcee8099129b38e885ccba14ea4fb14d. 2014-02-05 19:28:24,850 INFO [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1119): Closed observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:24,850 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(176): Closed observed_table,nnn,1391628496449.5b68e755b91897693a8ee58eae204d9d. 2014-02-05 19:28:24,850 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(125): Processing close of observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:24,850 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(125): Processing close of observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:24,851 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1039): Closing observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54.: disabling compactions & flushes 2014-02-05 19:28:24,851 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.: disabling compactions & flushes 2014-02-05 19:28:24,850 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(125): Processing close of observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:24,851 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:24,851 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1039): Closing observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.: disabling compactions & flushes 2014-02-05 19:28:24,851 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1061): Updates disabled for region observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:24,851 INFO [StoreCloserThread-observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,851 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1061): Updates disabled for region observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:24,852 INFO [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1119): Closed observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:24,852 INFO [StoreCloserThread-observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,852 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(176): Closed observed_table,,1391628496378.3df75a9a574dc10fbcdf4e5edf1f804a. 2014-02-05 19:28:24,852 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(125): Processing close of observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:24,853 INFO [StoreCloserThread-observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,853 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1039): Closing observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f.: disabling compactions & flushes 2014-02-05 19:28:24,853 INFO [RS_CLOSE_REGION-kiyo:56349-0] regionserver.HRegion(1119): Closed observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:24,853 INFO [RS_CLOSE_REGION-kiyo:56349-2] regionserver.HRegion(1119): Closed observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:24,853 DEBUG [RS_CLOSE_REGION-kiyo:56349-0] handler.CloseRegionHandler(176): Closed observed_table,iii,1391628496423.b33b2590e622c698e6ba5ab3cb993387. 2014-02-05 19:28:24,853 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1061): Updates disabled for region observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:24,853 DEBUG [RS_CLOSE_REGION-kiyo:56349-2] handler.CloseRegionHandler(176): Closed observed_table,eee,1391628496401.71a91a67fd785fd7bb819d8ab083ee54. 2014-02-05 19:28:24,854 INFO [StoreCloserThread-observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f.-1] regionserver.HStore(740): Closed aaa 2014-02-05 19:28:24,854 INFO [RS_CLOSE_REGION-kiyo:56349-1] regionserver.HRegion(1119): Closed observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:24,854 DEBUG [RS_CLOSE_REGION-kiyo:56349-1] handler.CloseRegionHandler(176): Closed observed_table,ccc,1391628496391.03da4845c5557152ef77ea032b50a62f. 2014-02-05 19:28:24,857 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:24,857 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node 5d8421effa9ecd23359141f148ae1b66 from RS_ZK_REGION_OPENING to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,858 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:24,858 ERROR [RS_OPEN_REGION-kiyo:56349-1] executor.EventHandler(131): Caught throwable while processing event M_RS_OPEN_REGION java.io.IOException: Aborting flush because server is abortted... at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1573) at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1556) at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1064) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1013) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:968) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.cleanupFailedOpen(OpenRegionHandler.java:499) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.doCleanUpOnFailedOpen(OpenRegionHandler.java:218) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:186) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,858 INFO [RS_OPEN_REGION-kiyo:56349-1] handler.OpenRegionHandler(436): Opening of region {ENCODED => d71919231008406bacce304f6ca7b653, NAME => 'observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.', STARTKEY => 'yyy', ENDKEY => ''} failed, transitioning from OFFLINE to FAILED_OPEN in ZK, expecting version 0 2014-02-05 19:28:24,859 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(832): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioning d71919231008406bacce304f6ca7b653 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,858 DEBUG [RS_OPEN_REGION-kiyo:56349-2] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node eb1ecc76644cb50a62647f4c2ef4a612 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,907 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:24,907 DEBUG [RS_OPEN_REGION-kiyo:56349-0] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node fa6cfdf1d37cc487932219986736fcd7 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,908 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/969db37065123ffec5eded7ad35041a6 2014-02-05 19:28:24,908 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-02-05 19:28:24,908 DEBUG [AM.ZK.Worker-pool15-t12] zookeeper.ZKAssign(480): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Deleted unassigned node 969db37065123ffec5eded7ad35041a6 in expected state RS_ZK_REGION_OPENED 2014-02-05 19:28:24,908 DEBUG [AM.ZK.Worker-pool15-t12] master.AssignmentManager$4(1175): Znode observed_table,mmm,1391628496444.969db37065123ffec5eded7ad35041a6. deleted, state: {969db37065123ffec5eded7ad35041a6 state=OPEN, ts=1391628504778, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,908 INFO [RS:0;kiyo:56349] regionserver.CompactSplitThread(357): Waiting for Split Thread to finish... 2014-02-05 19:28:24,909 INFO [RS:0;kiyo:56349] regionserver.CompactSplitThread(357): Waiting for Merge Thread to finish... 2014-02-05 19:28:24,909 INFO [RS:0;kiyo:56349] regionserver.CompactSplitThread(357): Waiting for Large Compaction Thread to finish... 2014-02-05 19:28:24,908 INFO [AM.ZK.Worker-pool15-t12] master.RegionStates(377): Onlined 969db37065123ffec5eded7ad35041a6 on kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,908 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(790): Handling RS_ZK_REGION_FAILED_OPEN, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=5d8421effa9ecd23359141f148ae1b66, current_state={5d8421effa9ecd23359141f148ae1b66 state=OPENING, ts=1391628504771, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,909 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(790): Handling RS_ZK_REGION_FAILED_OPEN, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=eb1ecc76644cb50a62647f4c2ef4a612, current_state={eb1ecc76644cb50a62647f4c2ef4a612 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,910 INFO [AM.ZK.Worker-pool15-t17] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=OPENING, ts=1391628504771, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {5d8421effa9ecd23359141f148ae1b66 state=CLOSED, ts=1391628504909, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,910 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2140): Can't move 5d8421effa9ecd23359141f148ae1b66, there is no destination server available. 2014-02-05 19:28:24,910 DEBUG [htable-pool32-t2] client.HConnectionManager$HConnectionImplementation(1413): Removed all cached region locations that map to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,909 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(790): Handling RS_ZK_REGION_FAILED_OPEN, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=fa6cfdf1d37cc487932219986736fcd7, current_state={fa6cfdf1d37cc487932219986736fcd7 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,909 INFO [RS:0;kiyo:56349] regionserver.CompactSplitThread(357): Waiting for Small Compaction Thread to finish... 2014-02-05 19:28:24,910 DEBUG [AM.ZK.Worker-pool15-t17] handler.ClosedRegionHandler(92): Handling CLOSED event for 5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:24,910 INFO [AM.ZK.Worker-pool15-t18] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {eb1ecc76644cb50a62647f4c2ef4a612 state=CLOSED, ts=1391628504910, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,911 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2140): Can't move eb1ecc76644cb50a62647f4c2ef4a612, there is no destination server available. 2014-02-05 19:28:24,911 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(1123): Waiting on 1 regions to close 2014-02-05 19:28:24,912 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {fa6cfdf1d37cc487932219986736fcd7 state=CLOSED, ts=1391628504912, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,912 DEBUG [RS_CLOSE_META-kiyo:56349-0] handler.CloseRegionHandler(125): Processing close of hbase:meta,,1.1588230740 2014-02-05 19:28:24,911 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2839): Waiting for 5d8421effa9ecd23359141f148ae1b66 to leave regions-in-transition, timeOut=15000 ms. 2014-02-05 19:28:24,912 DEBUG [RS_CLOSE_META-kiyo:56349-0] regionserver.HRegion(1039): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2014-02-05 19:28:24,913 DEBUG [RS_CLOSE_META-kiyo:56349-0] regionserver.HRegion(1061): Updates disabled for region hbase:meta,,1.1588230740 2014-02-05 19:28:24,912 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,913 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2192): Using pre-existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=kiyo.gq1.ygridcore.net,60181,1391628487831, dest=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,912 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2140): Can't move fa6cfdf1d37cc487932219986736fcd7, there is no destination server available. 2014-02-05 19:28:24,912 DEBUG [RS:0;kiyo:56349] regionserver.HRegionServer(1127): {1588230740=hbase:meta,,1.1588230740} 2014-02-05 19:28:24,911 DEBUG [AM.ZK.Worker-pool15-t18] handler.ClosedRegionHandler(92): Handling CLOSED event for eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:24,913 DEBUG [AM.ZK.Worker-pool15-t19] handler.ClosedRegionHandler(92): Handling CLOSED event for fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:24,913 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(740): Closed info 2014-02-05 19:28:24,913 INFO [AM.ZK.Worker-pool15-t17] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=CLOSED, ts=1391628504911, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {5d8421effa9ecd23359141f148ae1b66 state=OFFLINE, ts=1391628504913, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,914 DEBUG [AM.ZK.Worker-pool15-t17] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node 5d8421effa9ecd23359141f148ae1b66 with OFFLINE state 2014-02-05 19:28:24,914 INFO [RS_CLOSE_META-kiyo:56349-0] regionserver.HRegion(1119): Closed hbase:meta,,1.1588230740 2014-02-05 19:28:24,914 DEBUG [RS_CLOSE_META-kiyo:56349-0] handler.CloseRegionHandler(176): Closed hbase:meta,,1.1588230740 2014-02-05 19:28:24,914 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,914 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2192): Using pre-existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=kiyo.gq1.ygridcore.net,60181,1391628487831, dest=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,914 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,915 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2192): Using pre-existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=kiyo.gq1.ygridcore.net,60181,1391628487831, dest=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,915 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=CLOSED, ts=1391628504914, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {fa6cfdf1d37cc487932219986736fcd7 state=OFFLINE, ts=1391628504915, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,915 DEBUG [AM.ZK.Worker-pool15-t19] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node fa6cfdf1d37cc487932219986736fcd7 with OFFLINE state 2014-02-05 19:28:24,915 INFO [AM.ZK.Worker-pool15-t18] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=CLOSED, ts=1391628504914, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {eb1ecc76644cb50a62647f4c2ef4a612 state=OFFLINE, ts=1391628504915, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,915 DEBUG [AM.ZK.Worker-pool15-t18] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node eb1ecc76644cb50a62647f4c2ef4a612 with OFFLINE state 2014-02-05 19:28:24,928 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/ccabdaf5066a8b10de484bf12a2ef38f 2014-02-05 19:28:24,928 DEBUG [RS_OPEN_REGION-kiyo:56349-1] zookeeper.ZKAssign(907): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Transitioned node d71919231008406bacce304f6ca7b653 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_FAILED_OPEN 2014-02-05 19:28:24,928 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d71919231008406bacce304f6ca7b653 2014-02-05 19:28:24,929 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,929 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=OFFLINE, ts=1391628504835, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {ccabdaf5066a8b10de484bf12a2ef38f state=PENDING_OPEN, ts=1391628504929, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,929 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=1 of 10 java.io.IOException: Unexpected closed connection at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1440) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,930 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,930 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,930 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,931 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=2 of 10 java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:511) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:481) at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupConnection(RpcClient.java:577) at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:865) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,932 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,932 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,932 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,933 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=3 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,933 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,933 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,934 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,934 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=4 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,935 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,935 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,935 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,935 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=5 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,936 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,936 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,937 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,937 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=6 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,938 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,938 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,938 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,938 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=7 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,939 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,939 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,939 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,940 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=8 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,940 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,940 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,941 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,941 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=9 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,942 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2153): Found an existing plan for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,942 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f.; generated random plan=hri=observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,942 INFO [AM.ZK.Worker-pool15-t11] master.AssignmentManager(1912): Assigning observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,942 WARN [AM.ZK.Worker-pool15-t11] master.AssignmentManager(2004): Failed assignment of observed_table,sss,1391628496474.ccabdaf5066a8b10de484bf12a2ef38f. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=10 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,943 WARN [AM.ZK.Worker-pool15-t11] master.RegionStates(303): Failed to open/close ccabdaf5066a8b10de484bf12a2ef38f on kiyo.gq1.ygridcore.net,56349,1391628487792, set to FAILED_OPEN 2014-02-05 19:28:24,943 INFO [AM.ZK.Worker-pool15-t11] master.RegionStates(316): Transitioned {ccabdaf5066a8b10de484bf12a2ef38f state=PENDING_OPEN, ts=1391628504942, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {ccabdaf5066a8b10de484bf12a2ef38f state=FAILED_OPEN, ts=1391628504943, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,944 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5d8421effa9ecd23359141f148ae1b66 2014-02-05 19:28:24,944 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/fa6cfdf1d37cc487932219986736fcd7 2014-02-05 19:28:24,945 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(790): Handling RS_ZK_REGION_FAILED_OPEN, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=d71919231008406bacce304f6ca7b653, current_state={d71919231008406bacce304f6ca7b653 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,945 INFO [AM.ZK.Worker-pool15-t7] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=PENDING_OPEN, ts=1391628503895, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {d71919231008406bacce304f6ca7b653 state=CLOSED, ts=1391628504945, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,945 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2140): Can't move d71919231008406bacce304f6ca7b653, there is no destination server available. 2014-02-05 19:28:24,945 DEBUG [AM.ZK.Worker-pool15-t7] handler.ClosedRegionHandler(92): Handling CLOSED event for d71919231008406bacce304f6ca7b653 2014-02-05 19:28:24,945 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,946 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2192): Using pre-existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=kiyo.gq1.ygridcore.net,60181,1391628487831, dest=kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,946 INFO [AM.ZK.Worker-pool15-t7] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=CLOSED, ts=1391628504945, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {d71919231008406bacce304f6ca7b653 state=OFFLINE, ts=1391628504946, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,946 DEBUG [AM.ZK.Worker-pool15-t7] zookeeper.ZKAssign(206): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Creating (or updating) unassigned node d71919231008406bacce304f6ca7b653 with OFFLINE state 2014-02-05 19:28:24,961 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/eb1ecc76644cb50a62647f4c2ef4a612 2014-02-05 19:28:24,961 DEBUG [AM.ZK.Worker-pool15-t11] master.AssignmentManager(790): Handling M_ZK_REGION_OFFLINE, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=ccabdaf5066a8b10de484bf12a2ef38f, current_state={ccabdaf5066a8b10de484bf12a2ef38f state=FAILED_OPEN, ts=1391628504943, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,961 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,962 INFO [AM.ZK.Worker-pool15-t17] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=OFFLINE, ts=1391628504913, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {5d8421effa9ecd23359141f148ae1b66 state=PENDING_OPEN, ts=1391628504961, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,962 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,962 INFO [AM.ZK.Worker-pool15-t18] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=OFFLINE, ts=1391628504915, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {eb1ecc76644cb50a62647f4c2ef4a612 state=PENDING_OPEN, ts=1391628504962, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,962 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=1 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,962 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=1 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,961 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,963 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,964 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=OFFLINE, ts=1391628504915, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {fa6cfdf1d37cc487932219986736fcd7 state=PENDING_OPEN, ts=1391628504964, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,964 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,964 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,964 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,964 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,964 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=1 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,965 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=2 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,965 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,965 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,966 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,966 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=2 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,967 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,967 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,966 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,968 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,968 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,968 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,967 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,968 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=3 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,971 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=3 of 10 java.io.IOException: Call to kiyo.gq1.ygridcore.net/68.142.244.61:56349 failed on local exception: org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1479) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1451) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) Caused by: org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) ... 17 more 2014-02-05 19:28:24,972 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,973 INFO [AM.ZK.Worker-pool15-t7] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=OFFLINE, ts=1391628504946, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {d71919231008406bacce304f6ca7b653 state=PENDING_OPEN, ts=1391628504973, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:24,971 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,971 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d71919231008406bacce304f6ca7b653 2014-02-05 19:28:24,974 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,974 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,971 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=2 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,974 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=4 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,974 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=1 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,974 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,976 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,976 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,976 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,976 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,976 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,977 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=4 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,977 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,977 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,977 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,978 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,978 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,978 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,978 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,979 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=3 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,979 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=5 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,979 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,979 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,982 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,978 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=2 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,982 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=5 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,982 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,984 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,982 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,984 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,984 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=4 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,984 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,985 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,984 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,984 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,986 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,986 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=6 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,987 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,986 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,988 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,988 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,988 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,986 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,989 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,986 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,989 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=7 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,989 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=3 of 10 java.io.IOException: Call to kiyo.gq1.ygridcore.net/68.142.244.61:56349 failed on local exception: org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1479) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1451) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) Caused by: org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) ... 17 more 2014-02-05 19:28:24,989 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=6 of 10 java.io.IOException: Call to kiyo.gq1.ygridcore.net/68.142.244.61:56349 failed on local exception: org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1479) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1451) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) Caused by: org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) ... 17 more 2014-02-05 19:28:24,989 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=5 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,990 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,993 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,993 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,993 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,994 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,994 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,994 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=8 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,994 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,994 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,994 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,995 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=6 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,995 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,995 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,995 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,996 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,996 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,996 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,997 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=4 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,996 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,996 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=7 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,998 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:24,998 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:24,997 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,997 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=9 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,999 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=7 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:24,999 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:24,999 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,000 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,000 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,000 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,001 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2153): Found an existing plan for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,001 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=5 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,001 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,002 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,001 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612.; generated random plan=hri=observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,002 INFO [AM.ZK.Worker-pool15-t18] master.AssignmentManager(1912): Assigning observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,001 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,002 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=8 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,002 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,003 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,003 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,003 WARN [AM.ZK.Worker-pool15-t18] master.AssignmentManager(2004): Failed assignment of observed_table,ttt,1391628496479.eb1ecc76644cb50a62647f4c2ef4a612. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=10 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,004 WARN [AM.ZK.Worker-pool15-t18] master.RegionStates(303): Failed to open/close eb1ecc76644cb50a62647f4c2ef4a612 on kiyo.gq1.ygridcore.net,56349,1391628487792, set to FAILED_OPEN 2014-02-05 19:28:25,004 INFO [AM.ZK.Worker-pool15-t18] master.RegionStates(316): Transitioned {eb1ecc76644cb50a62647f4c2ef4a612 state=PENDING_OPEN, ts=1391628505002, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {eb1ecc76644cb50a62647f4c2ef4a612 state=FAILED_OPEN, ts=1391628505004, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,002 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,004 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=6 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,004 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,005 DEBUG [AM.ZK.Worker-pool15-t18] master.AssignmentManager(790): Handling M_ZK_REGION_OFFLINE, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=eb1ecc76644cb50a62647f4c2ef4a612, current_state={eb1ecc76644cb50a62647f4c2ef4a612 state=FAILED_OPEN, ts=1391628505004, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,005 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,005 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=8 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,006 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,005 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,007 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,006 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,007 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=9 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,007 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=7 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,007 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,008 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2153): Found an existing plan for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,008 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,009 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,009 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66.; generated random plan=hri=observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,009 INFO [AM.ZK.Worker-pool15-t17] master.AssignmentManager(1912): Assigning observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,009 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,009 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=9 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,010 WARN [AM.ZK.Worker-pool15-t17] master.AssignmentManager(2004): Failed assignment of observed_table,ppp,1391628496459.5d8421effa9ecd23359141f148ae1b66. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=10 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,012 WARN [AM.ZK.Worker-pool15-t17] master.RegionStates(303): Failed to open/close 5d8421effa9ecd23359141f148ae1b66 on kiyo.gq1.ygridcore.net,56349,1391628487792, set to FAILED_OPEN 2014-02-05 19:28:25,012 INFO [AM.ZK.Worker-pool15-t17] master.RegionStates(316): Transitioned {5d8421effa9ecd23359141f148ae1b66 state=PENDING_OPEN, ts=1391628505009, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {5d8421effa9ecd23359141f148ae1b66 state=FAILED_OPEN, ts=1391628505012, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,009 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,010 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2153): Found an existing plan for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,013 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7.; generated random plan=hri=observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,013 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=8 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,013 DEBUG [AM.ZK.Worker-pool15-t17] master.AssignmentManager(790): Handling M_ZK_REGION_OFFLINE, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=5d8421effa9ecd23359141f148ae1b66, current_state={5d8421effa9ecd23359141f148ae1b66 state=FAILED_OPEN, ts=1391628505012, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,013 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,013 INFO [AM.ZK.Worker-pool15-t19] master.AssignmentManager(1912): Assigning observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,014 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,014 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,014 WARN [AM.ZK.Worker-pool15-t19] master.AssignmentManager(2004): Failed assignment of observed_table,vvv,1391628496489.fa6cfdf1d37cc487932219986736fcd7. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=10 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,015 WARN [AM.ZK.Worker-pool15-t19] master.RegionStates(303): Failed to open/close fa6cfdf1d37cc487932219986736fcd7 on kiyo.gq1.ygridcore.net,56349,1391628487792, set to FAILED_OPEN 2014-02-05 19:28:25,015 INFO [AM.ZK.Worker-pool15-t19] master.RegionStates(316): Transitioned {fa6cfdf1d37cc487932219986736fcd7 state=PENDING_OPEN, ts=1391628505014, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {fa6cfdf1d37cc487932219986736fcd7 state=FAILED_OPEN, ts=1391628505015, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,014 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=9 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,015 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2153): Found an existing plan for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. destination server is kiyo.gq1.ygridcore.net,56349,1391628487792 accepted as a dest server = true 2014-02-05 19:28:25,016 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2183): No previous transition plan found (or ignoring an existing plan) for observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653.; generated random plan=hri=observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653., src=, dest=kiyo.gq1.ygridcore.net,56349,1391628487792; 1 (online=1, available=1) available servers, forceNewPlan=true 2014-02-05 19:28:25,016 DEBUG [AM.ZK.Worker-pool15-t19] master.AssignmentManager(790): Handling M_ZK_REGION_OFFLINE, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=fa6cfdf1d37cc487932219986736fcd7, current_state={fa6cfdf1d37cc487932219986736fcd7 state=FAILED_OPEN, ts=1391628505015, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,016 INFO [AM.ZK.Worker-pool15-t7] master.AssignmentManager(1912): Assigning observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,016 WARN [AM.ZK.Worker-pool15-t7] master.AssignmentManager(2004): Failed assignment of observed_table,yyy,1391628496504.d71919231008406bacce304f6ca7b653. to kiyo.gq1.ygridcore.net,56349,1391628487792, trying to assign elsewhere instead; try=10 of 10 org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.openRegion(AdminProtos.java:20595) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:633) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1926) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:104) at org.apache.hadoop.hbase.master.AssignmentManager.handleRegion(AssignmentManager.java:899) at org.apache.hadoop.hbase.master.AssignmentManager$6.run(AssignmentManager.java:1305) at org.apache.hadoop.hbase.master.AssignmentManager$3.run(AssignmentManager.java:1127) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2014-02-05 19:28:25,017 WARN [AM.ZK.Worker-pool15-t7] master.RegionStates(303): Failed to open/close d71919231008406bacce304f6ca7b653 on kiyo.gq1.ygridcore.net,56349,1391628487792, set to FAILED_OPEN 2014-02-05 19:28:25,017 INFO [AM.ZK.Worker-pool15-t7] master.RegionStates(316): Transitioned {d71919231008406bacce304f6ca7b653 state=PENDING_OPEN, ts=1391628505016, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {d71919231008406bacce304f6ca7b653 state=FAILED_OPEN, ts=1391628505017, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,018 DEBUG [AM.ZK.Worker-pool15-t7] master.AssignmentManager(790): Handling M_ZK_REGION_OFFLINE, server=kiyo.gq1.ygridcore.net,56349,1391628487792, region=d71919231008406bacce304f6ca7b653, current_state={d71919231008406bacce304f6ca7b653 state=FAILED_OPEN, ts=1391628505017, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,114 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(979): stopping server kiyo.gq1.ygridcore.net,56349,1391628487792; all regions closed. 2014-02-05 19:28:25,114 DEBUG [RS_OPEN_META-kiyo:56349-0-WAL.AsyncNotifier] wal.FSHLog$AsyncNotifier(1332): RS_OPEN_META-kiyo:56349-0-WAL.AsyncNotifier interrupted while waiting for notification from AsyncSyncer thread 2014-02-05 19:28:25,114 INFO [RS_OPEN_META-kiyo:56349-0-WAL.AsyncNotifier] wal.FSHLog$AsyncNotifier(1337): RS_OPEN_META-kiyo:56349-0-WAL.AsyncNotifier exiting 2014-02-05 19:28:25,114 DEBUG [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer0] wal.FSHLog$AsyncSyncer(1278): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer0 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,115 INFO [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer0] wal.FSHLog$AsyncSyncer(1283): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer0 exiting 2014-02-05 19:28:25,115 DEBUG [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer1] wal.FSHLog$AsyncSyncer(1278): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer1 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,115 INFO [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer1] wal.FSHLog$AsyncSyncer(1283): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer1 exiting 2014-02-05 19:28:25,115 DEBUG [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer2] wal.FSHLog$AsyncSyncer(1278): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer2 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,115 INFO [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer2] wal.FSHLog$AsyncSyncer(1283): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer2 exiting 2014-02-05 19:28:25,116 DEBUG [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer3] wal.FSHLog$AsyncSyncer(1278): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer3 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,116 INFO [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer3] wal.FSHLog$AsyncSyncer(1283): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer3 exiting 2014-02-05 19:28:25,116 DEBUG [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer4] wal.FSHLog$AsyncSyncer(1278): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer4 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,116 INFO [RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer4] wal.FSHLog$AsyncSyncer(1283): RS_OPEN_META-kiyo:56349-0-WAL.AsyncSyncer4 exiting 2014-02-05 19:28:25,116 DEBUG [RS_OPEN_META-kiyo:56349-0-WAL.AsyncWriter] wal.FSHLog$AsyncWriter(1153): RS_OPEN_META-kiyo:56349-0-WAL.AsyncWriter interrupted while waiting for newer writes added to local buffer 2014-02-05 19:28:25,116 INFO [RS_OPEN_META-kiyo:56349-0-WAL.AsyncWriter] wal.FSHLog$AsyncWriter(1158): RS_OPEN_META-kiyo:56349-0-WAL.AsyncWriter exiting 2014-02-05 19:28:25,117 DEBUG [RS:0;kiyo:56349] wal.FSHLog(938): Closing WAL writer in hdfs://localhost:53087/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,142 DEBUG [RS:0;kiyo:56349-WAL.AsyncNotifier] wal.FSHLog$AsyncNotifier(1332): RS:0;kiyo:56349-WAL.AsyncNotifier interrupted while waiting for notification from AsyncSyncer thread 2014-02-05 19:28:25,142 INFO [RS:0;kiyo:56349-WAL.AsyncNotifier] wal.FSHLog$AsyncNotifier(1337): RS:0;kiyo:56349-WAL.AsyncNotifier exiting 2014-02-05 19:28:25,142 DEBUG [RS:0;kiyo:56349-WAL.AsyncSyncer0] wal.FSHLog$AsyncSyncer(1278): RS:0;kiyo:56349-WAL.AsyncSyncer0 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,142 INFO [RS:0;kiyo:56349-WAL.AsyncSyncer0] wal.FSHLog$AsyncSyncer(1283): RS:0;kiyo:56349-WAL.AsyncSyncer0 exiting 2014-02-05 19:28:25,142 DEBUG [RS:0;kiyo:56349-WAL.AsyncSyncer1] wal.FSHLog$AsyncSyncer(1278): RS:0;kiyo:56349-WAL.AsyncSyncer1 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,143 INFO [RS:0;kiyo:56349-WAL.AsyncSyncer1] wal.FSHLog$AsyncSyncer(1283): RS:0;kiyo:56349-WAL.AsyncSyncer1 exiting 2014-02-05 19:28:25,143 DEBUG [RS:0;kiyo:56349-WAL.AsyncSyncer2] wal.FSHLog$AsyncSyncer(1278): RS:0;kiyo:56349-WAL.AsyncSyncer2 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,143 INFO [RS:0;kiyo:56349-WAL.AsyncSyncer2] wal.FSHLog$AsyncSyncer(1283): RS:0;kiyo:56349-WAL.AsyncSyncer2 exiting 2014-02-05 19:28:25,143 DEBUG [RS:0;kiyo:56349-WAL.AsyncSyncer3] wal.FSHLog$AsyncSyncer(1278): RS:0;kiyo:56349-WAL.AsyncSyncer3 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,143 INFO [RS:0;kiyo:56349-WAL.AsyncSyncer3] wal.FSHLog$AsyncSyncer(1283): RS:0;kiyo:56349-WAL.AsyncSyncer3 exiting 2014-02-05 19:28:25,143 DEBUG [RS:0;kiyo:56349-WAL.AsyncSyncer4] wal.FSHLog$AsyncSyncer(1278): RS:0;kiyo:56349-WAL.AsyncSyncer4 interrupted while waiting for notification from AsyncWriter thread 2014-02-05 19:28:25,144 INFO [RS:0;kiyo:56349-WAL.AsyncSyncer4] wal.FSHLog$AsyncSyncer(1283): RS:0;kiyo:56349-WAL.AsyncSyncer4 exiting 2014-02-05 19:28:25,144 DEBUG [RS:0;kiyo:56349-WAL.AsyncWriter] wal.FSHLog$AsyncWriter(1153): RS:0;kiyo:56349-WAL.AsyncWriter interrupted while waiting for newer writes added to local buffer 2014-02-05 19:28:25,144 INFO [RS:0;kiyo:56349-WAL.AsyncWriter] wal.FSHLog$AsyncWriter(1158): RS:0;kiyo:56349-WAL.AsyncWriter exiting 2014-02-05 19:28:25,144 DEBUG [RS:0;kiyo:56349] wal.FSHLog(938): Closing WAL writer in hdfs://localhost:53087/user/hortonzy/hbase/WALs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,188 INFO [RS:0;kiyo:56349.periodicFlusher] hbase.Chore(93): RS:0;kiyo:56349.periodicFlusher exiting 2014-02-05 19:28:25,191 INFO [RS:0;kiyo:56349.leaseChecker] regionserver.Leases(147): RS:0;kiyo:56349.leaseChecker closing leases 2014-02-05 19:28:25,191 INFO [RS:0;kiyo:56349.leaseChecker] regionserver.Leases(150): RS:0;kiyo:56349.leaseChecker closed leases 2014-02-05 19:28:25,216 WARN [htable-pool32-t2] client.HConnectionManager$HConnectionImplementation(1164): Encountered problems when prefetch hbase:meta table: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=2, exceptions: Wed Feb 05 19:28:24 UTC 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@2a0c5bd6, java.net.ConnectException: Connection refused Wed Feb 05 19:28:25 UTC 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@2a0c5bd6, org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:136) at org.apache.hadoop.hbase.client.HTable.getRowOrBefore(HTable.java:705) at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:144) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:1158) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1222) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1110) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1067) at org.apache.hadoop.hbase.client.AsyncProcess.findDestLocation(AsyncProcess.java:356) at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:492) at org.apache.hadoop.hbase.client.AsyncProcess.logAndResubmit(AsyncProcess.java:701) at org.apache.hadoop.hbase.client.AsyncProcess.receiveGlobalFailure(AsyncProcess.java:648) at org.apache.hadoop.hbase.client.AsyncProcess.access$100(AsyncProcess.java:90) at org.apache.hadoop.hbase.client.AsyncProcess$1.run(AsyncProcess.java:532) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) Caused by: org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:850) at org.apache.hadoop.hbase.ipc.RpcClient.getConnection(RpcClient.java:1533) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1432) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1651) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1709) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.get(ClientProtos.java:28833) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRowOrBefore(ProtobufUtil.java:1470) at org.apache.hadoop.hbase.client.HTable$2.call(HTable.java:701) at org.apache.hadoop.hbase.client.HTable$2.call(HTable.java:699) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:121) ... 18 more 2014-02-05 19:28:25,217 DEBUG [htable-pool32-t2] client.HConnectionManager$HConnectionImplementation(1301): locateRegionInMeta parentTable=hbase:meta, metaLocation={region=hbase:meta,,1.1588230740, hostname=kiyo.gq1.ygridcore.net,56349,1391628487792, seqNum=0}, attempt=0 of 2 failed; retrying after sleep of 100 because: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 2014-02-05 19:28:25,448 INFO [RS:0;kiyo:56349] regionserver.Leases(147): RS:0;kiyo:56349 closing leases 2014-02-05 19:28:25,449 INFO [RS:0;kiyo:56349] regionserver.Leases(150): RS:0;kiyo:56349 closed leases 2014-02-05 19:28:25,483 INFO [RS:0;kiyo:56349] client.HConnectionManager$HConnectionImplementation(1856): Closing zookeeper sessionid=0x144038588cb0008 2014-02-05 19:28:25,522 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,522 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,522 INFO [Thread-204-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [kiyo.gq1.ygridcore.net,56349,1391628487792] 2014-02-05 19:28:25,522 DEBUG [RS:0;kiyo:56349-EventThread] zookeeper.ZooKeeperWatcher(310): regionserver:56349-0x144038588cb0002, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-02-05 19:28:25,549 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(1011): stopping server kiyo.gq1.ygridcore.net,56349,1391628487792; zookeeper connection closed. 2014-02-05 19:28:25,549 DEBUG [Thread-204-EventThread] master.AssignmentManager(3078): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,56349,1391628487792 server being checked: kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,550 INFO [RS:0;kiyo:56349] regionserver.HRegionServer(1014): RS:0;kiyo:56349 exiting 2014-02-05 19:28:25,550 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@16e2e222] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(190): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@16e2e222 2014-02-05 19:28:25,551 DEBUG [Thread-204-EventThread] master.ServerManager(517): Added=kiyo.gq1.ygridcore.net,56349,1391628487792 to dead servers, submitted shutdown handler to be executed meta=true 2014-02-05 19:28:25,551 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-02-05 19:28:25,552 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] handler.MetaServerShutdownHandler(58): Splitting hbase:meta logs for kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,553 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.ZKUtil(687): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/recovering-regions/1588230740 because node does not exist (not an error) 2014-02-05 19:28:25,589 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.SplitLogManager(1162): Mark region 1588230740 recovering from failed region server kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,589 DEBUG [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(3078): based on AM, current region=hbase:meta,,1.1588230740 is on server=kiyo.gq1.ygridcore.net,56349,1391628487792 server being checked: kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,590 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] handler.MetaServerShutdownHandler(78): Server kiyo.gq1.ygridcore.net,56349,1391628487792 was carrying META. Trying to assign. 2014-02-05 19:28:25,590 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(316): Transitioned {1588230740 state=OPEN, ts=1391628492465, server=kiyo.gq1.ygridcore.net,56349,1391628487792} to {1588230740 state=OFFLINE, ts=1391628505590, server=kiyo.gq1.ygridcore.net,56349,1391628487792} 2014-02-05 19:28:25,590 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.RegionStates(461): Offlined 1588230740 from kiyo.gq1.ygridcore.net,56349,1391628487792 2014-02-05 19:28:25,597 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] catalog.CatalogTracker(412): Failed verification of hbase:meta,,1 at address=kiyo.gq1.ygridcore.net,56349,1391628487792, exception=org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: kiyo.gq1.ygridcore.net/68.142.244.61:56349 2014-02-05 19:28:25,597 INFO [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] zookeeper.MetaRegionTracker(164): Unsetting hbase:meta region location in ZooKeeper 2014-02-05 19:28:25,615 DEBUG [Thread-204-EventThread] zookeeper.ZooKeeperWatcher(310): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/meta-region-server 2014-02-05 19:28:25,616 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:25,616 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:25,616 DEBUG [Thread-204-EventThread] zookeeper.ZKUtil(430): master:48976-0x144038588cb0000, quorum=localhost:56427, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/meta-region-server 2014-02-05 19:28:25,624 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:25,771 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager$NodeFailoverWorker(491): Not transferring queue since we are shutting down 2014-02-05 19:28:25,825 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:26,026 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:26,228 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:26,429 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:26,616 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:26,616 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:26,630 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:26,831 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:27,032 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:27,234 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:27,435 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:27,616 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:27,617 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:27,637 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:27,838 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:28,039 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:28,240 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:28,442 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:28,617 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:28,617 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:28,643 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:28,844 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:29,046 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:29,247 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:29,448 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:29,618 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:29,618 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:29,650 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:29,851 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:30,052 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:30,253 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:30,454 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:30,618 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:30,619 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:30,655 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:30,856 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:31,058 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:31,259 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:31,460 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:31,619 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:31,619 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:31,662 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:31,863 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:32,064 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:32,265 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:32,467 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:32,620 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:32,620 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:32,668 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:32,869 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:33,070 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:33,271 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:33,473 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:33,620 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:33,620 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:33,674 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:33,875 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:34,076 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:34,278 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:34,479 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:34,621 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:34,621 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:34,680 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:34,881 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:35,083 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:35,284 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:35,485 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:35,621 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:35,621 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:35,686 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:35,887 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:36,088 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:36,289 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:36,490 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:36,622 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:36,622 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:36,691 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:36,892 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:37,094 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:37,295 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:37,496 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:37,622 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:37,622 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:37,697 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:37,898 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:38,099 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:38,301 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:38,502 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:38,623 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:38,623 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:38,703 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:38,905 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:39,106 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:39,307 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:39,508 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:39,623 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:39,623 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:39,709 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:39,910 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:39,915 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2844): Timed out on waiting for 5d8421effa9ecd23359141f148ae1b66 to be assigned. 2014-02-05 19:28:39,915 WARN [MASTER_SERVER_OPERATIONS-kiyo:48976-0] handler.ServerShutdownHandler(295): Region 5d8421effa9ecd23359141f148ae1b66 didn't complete assignment in time 2014-02-05 19:28:39,915 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2839): Waiting for ccabdaf5066a8b10de484bf12a2ef38f to leave regions-in-transition, timeOut=15000 ms. 2014-02-05 19:28:40,112 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:40,313 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:40,514 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:40,624 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:40,624 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:40,715 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:40,916 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:41,117 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:41,318 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:41,520 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:41,624 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:41,624 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:41,721 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:41,922 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:42,123 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:42,324 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:42,525 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:42,625 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:42,625 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:42,726 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:42,927 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:43,128 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:43,329 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:43,530 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:43,625 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:43,625 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:43,732 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:43,933 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:44,134 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:44,335 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:44,536 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:44,626 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:44,626 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:44,737 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:44,938 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:45,139 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:45,340 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:45,541 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:45,626 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:45,626 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:45,743 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:45,944 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:46,145 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:46,346 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:46,547 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:46,627 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:46,627 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:46,748 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:46,950 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:47,151 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:47,352 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:47,553 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:47,627 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:47,627 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:47,755 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:47,956 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:48,157 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:48,358 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:48,560 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:48,628 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:48,628 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:48,761 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:48,962 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:49,163 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:49,364 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:49,566 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:49,628 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:49,628 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:49,767 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:49,968 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:50,169 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:50,371 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:50,572 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:50,629 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:50,629 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:50,773 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:50,975 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:51,176 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:51,377 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:51,578 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:51,629 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:51,629 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:51,780 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:51,981 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:52,182 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:52,383 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:52,584 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:52,630 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:52,630 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:52,785 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:52,987 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:53,188 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:53,389 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:53,590 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:53,630 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:53,630 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:53,791 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:53,993 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:54,194 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:54,395 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:54,596 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:54,631 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:54,631 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:54,798 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:54,942 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2844): Timed out on waiting for ccabdaf5066a8b10de484bf12a2ef38f to be assigned. 2014-02-05 19:28:54,942 WARN [MASTER_SERVER_OPERATIONS-kiyo:48976-0] handler.ServerShutdownHandler(295): Region ccabdaf5066a8b10de484bf12a2ef38f didn't complete assignment in time 2014-02-05 19:28:54,943 INFO [MASTER_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2839): Waiting for eb1ecc76644cb50a62647f4c2ef4a612 to leave regions-in-transition, timeOut=15000 ms. 2014-02-05 19:28:54,999 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:55,200 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:55,401 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:55,603 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:55,631 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:55,631 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:55,804 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:56,005 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:56,206 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:56,408 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:56,609 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:56,631 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:56,632 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:56,810 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:57,011 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:57,213 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:57,414 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:57,615 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:57,632 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:57,632 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:57,816 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:58,018 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:58,219 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:58,420 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:58,621 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:58,633 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:58,633 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:58,823 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:59,024 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:59,225 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:59,427 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:59,628 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:28:59,633 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:28:59,633 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:28:59,829 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:00,030 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:00,232 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:00,433 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:00,633 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:29:00,634 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:29:00,634 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:00,835 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:01,037 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:01,238 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:01,439 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-02-05 19:29:01,630 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: coprocessor.TestRegionServerCoprocessorExceptionWithAbort#testExceptionFromCoprocessorDuringPut Thread=137 (was 26) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.FSNamesystem$ReplicationMonitor@75905090 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.FSNamesystem$ReplicationMonitor.run(FSNamesystem.java:3167) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: 338317553@qtp-1171821625-1 - Acceptor0 SelectChannelConnector@localhost:58065 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498) org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192) org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124) org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Potentially hanging thread: pool-52-thread-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:373) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: RpcServer.reader=5,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 1 on 60697 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: IPC Server Responder sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.hadoop.ipc.Server$Responder.run(Server.java:645) Potentially hanging thread: org.apache.hadoop.hdfs.server.datanode.DataBlockScanner@e25df95 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:621) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: DataNode: [/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data1,/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data2] java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.DataNode.offerService(DataNode.java:1149) org.apache.hadoop.hdfs.server.datanode.DataNode.run(DataNode.java:1588) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.LeaseManager$Monitor@376f026 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.LeaseManager$Monitor.run(LeaseManager.java:368) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: FifoRpcScheduler.handler5-thread-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:374) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: pool-53-thread-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:373) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: SplitLogWorker-kiyo.gq1.ygridcore.net,56349,1391628487792-SendThread(localhost:56427) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) Potentially hanging thread: org.apache.hadoop.hdfs.server.datanode.DataBlockScanner@1c80a74e java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:621) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server Responder sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.hadoop.ipc.Server$Responder.run(Server.java:645) Potentially hanging thread: IPC Server handler 3 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: IPC Server handler 7 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: pool-51-thread-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:373) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server listener on 60697 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.ipc.Server$Listener.run(Server.java:479) Potentially hanging thread: 1598541614@qtp-1130069804-0 java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Potentially hanging thread: Async Block Report Generator java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.FSDataset$AsyncBlockReport.waitForReportRequest(FSDataset.java:2279) org.apache.hadoop.hdfs.server.datanode.FSDataset$AsyncBlockReport.run(FSDataset.java:2250) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 9 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: kiyo.gq1.ygridcore.net,48976,1391628487578-BalancerChore java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92) org.apache.hadoop.hbase.Chore.run(Chore.java:88) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: MASTER_SERVER_OPERATIONS-kiyo:48976-0 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.master.RegionStates.waitForUpdate(RegionStates.java:214) org.apache.hadoop.hbase.master.AssignmentManager.waitOnRegionToClearRegionsInTransition(AssignmentManager.java:2842) org.apache.hadoop.hbase.master.handler.ServerShutdownHandler.process(ServerShutdownHandler.java:292) org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: refreshUsed-/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data1 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:80) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: 1837102910@qtp-234064594-1 - Acceptor0 SelectChannelConnector@localhost:51377 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498) org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192) org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124) org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Potentially hanging thread: Timer-7 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MASTER_TABLE_OPERATIONS-kiyo:48976-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 1 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@1cc8cca6 sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241) sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:100) org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:132) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: RpcServer.reader=4,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 5 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: htable-pool25-t1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: SplitLogWorker-kiyo.gq1.ygridcore.net,56349,1391628487792-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.PendingReplicationBlocks$PendingReplicationMonitor@48b81f68 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.PendingReplicationBlocks$PendingReplicationMonitor.run(PendingReplicationBlocks.java:197) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: RpcServer.reader=8,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: FifoRpcScheduler.handler5-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:374) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: 344385570@qtp-1130069804-1 - Acceptor0 SelectChannelConnector@localhost:54731 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498) org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192) org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124) org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Potentially hanging thread: Async Block Report Generator java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.FSDataset$AsyncBlockReport.waitForReportRequest(FSDataset.java:2279) org.apache.hadoop.hdfs.server.datanode.FSDataset$AsyncBlockReport.run(FSDataset.java:2250) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: refreshUsed-/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data2 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:80) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@546f743d sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241) sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:100) org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:132) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: 1650384942@qtp-234064594-0 java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Potentially hanging thread: CatalogJanitor-kiyo:48976 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92) org.apache.hadoop.hbase.Chore.run(Chore.java:88) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: RpcServer.reader=1,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: kiyo.gq1.ygridcore.net,48976,1391628487578-ClusterStatusChore java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92) org.apache.hadoop.hbase.Chore.run(Chore.java:88) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: Thread-204-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) Potentially hanging thread: JvmPauseMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:159) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: RpcServer.reader=3,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: kiyo.gq1.ygridcore.net,48976,1391628487578.splitLogManagerTimeoutMonitor java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92) org.apache.hadoop.hbase.Chore.run(Chore.java:88) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: M:0;kiyo:48976-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) Potentially hanging thread: IPC Server listener on 43029 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.ipc.Server$Listener.run(Server.java:479) Potentially hanging thread: IPC Server listener on 53087 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.ipc.Server$Listener.run(Server.java:479) Potentially hanging thread: IPC Server handler 6 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: refreshUsed-/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data3 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:80) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 0 on 60697 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: M:0;kiyo:48976-SendThread(localhost:56427) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) Potentially hanging thread: IPC Server handler 2 on 43029 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: htable-pool32-t2 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.zookeeper.ZKUtil.blockUntilAvailable(ZKUtil.java:1842) org.apache.hadoop.hbase.zookeeper.MetaRegionTracker.blockUntilAvailable(MetaRegionTracker.java:183) org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:58) org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1107) org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:1087) org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:908) org.apache.hadoop.hbase.client.RegionServerCallable.prepare(RegionServerCallable.java:72) org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:120) org.apache.hadoop.hbase.client.HTable.getRowOrBefore(HTable.java:705) org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:144) org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:1158) org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1222) org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1110) org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1067) org.apache.hadoop.hbase.client.AsyncProcess.findDestLocation(AsyncProcess.java:356) org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:492) org.apache.hadoop.hbase.client.AsyncProcess.logAndResubmit(AsyncProcess.java:701) org.apache.hadoop.hbase.client.AsyncProcess.receiveGlobalFailure(AsyncProcess.java:648) org.apache.hadoop.hbase.client.AsyncProcess.access$100(AsyncProcess.java:90) org.apache.hadoop.hbase.client.AsyncProcess$1.run(AsyncProcess.java:532) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) java.util.concurrent.FutureTask.run(FutureTask.java:166) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: Thread-204-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) Potentially hanging thread: AM.ZK.Worker-pool15-t13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: refreshUsed-/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data4 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:80) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: ProcessThread(sid:0 cport:-1): sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120) Potentially hanging thread: M:0;kiyo:48976.archivedHFileCleaner java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92) org.apache.hadoop.hbase.Chore.run(Chore.java:88) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: 2118285111@qtp-1171821625-0 java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Potentially hanging thread: RpcServer.reader=2,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 8 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: IPC Server handler 1 on 43029 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: org.apache.hadoop.hdfs.LeaseRenewer$1@25403f06 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.LeaseRenewer.run(LeaseRenewer.java:397) org.apache.hadoop.hdfs.LeaseRenewer.access$600(LeaseRenewer.java:69) org.apache.hadoop.hdfs.LeaseRenewer$1.run(LeaseRenewer.java:273) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: M:0;kiyo:48976-SendThread(localhost:56427) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) Potentially hanging thread: AM.ZK.Worker-pool15-t1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: SplitLogWorker-kiyo.gq1.ygridcore.net,60181,1391628487831-SendThread(localhost:56427) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) Potentially hanging thread: FifoRpcScheduler.handler5-thread-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:374) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 2 on 60697 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: org.apache.hadoop.hdfs.LeaseRenewer$1@7361f02e java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.LeaseRenewer.run(LeaseRenewer.java:397) org.apache.hadoop.hdfs.LeaseRenewer.access$600(LeaseRenewer.java:69) org.apache.hadoop.hdfs.LeaseRenewer$1.run(LeaseRenewer.java:273) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 4 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: IPC Server handler 2 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: AM.ZK.Worker-pool15-t12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: Thread-204-SendThread(localhost:56427) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) Potentially hanging thread: Thread-204 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.client.AsyncProcess.waitForNextTaskDone(AsyncProcess.java:837) org.apache.hadoop.hbase.client.AsyncProcess.waitForMaximumCurrentTasks(AsyncProcess.java:863) org.apache.hadoop.hbase.client.AsyncProcess.waitUntilDone(AsyncProcess.java:876) org.apache.hadoop.hbase.client.HTable.backgroundFlushCommits(HTable.java:945) org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1225) org.apache.hadoop.hbase.client.HTable.close(HTable.java:1262) org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort.testExceptionFromCoprocessorDuringPut(TestRegionServerCoprocessorExceptionWithAbort.java:133) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) Potentially hanging thread: M:0;kiyo:48976.oldLogCleaner java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92) org.apache.hadoop.hbase.Chore.run(Chore.java:88) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server handler 0 on 53087 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: Timer-5 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: AM.ZK.Worker-pool15-t2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: RpcServer.listener,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener.run(RpcServer.java:676) Potentially hanging thread: M:0;kiyo:48976-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) Potentially hanging thread: RpcServer.responder sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.hadoop.hbase.ipc.RpcServer$Responder.doRunLoop(RpcServer.java:866) org.apache.hadoop.hbase.ipc.RpcServer$Responder.run(RpcServer.java:849) Potentially hanging thread: AM.ZK.Worker-pool15-t8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: MASTER_META_SERVER_OPERATIONS-kiyo:48976-0 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1869) org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1433) org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1406) org.apache.hadoop.hbase.master.AssignmentManager.assignMeta(AssignmentManager.java:2424) org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.verifyAndAssignMeta(MetaServerShutdownHandler.java:143) org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.verifyAndAssignMetaWithRetries(MetaServerShutdownHandler.java:167) org.apache.hadoop.hbase.master.handler.MetaServerShutdownHandler.process(MetaServerShutdownHandler.java:80) org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: Timer-6 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: snapshot-hfile-cleaner-cache-refresher java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RpcServer.reader=0,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Client (47) connection to localhost/127.0.0.1:53087 from hortonzy java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:747) org.apache.hadoop.ipc.Client$Connection.run(Client.java:789) Potentially hanging thread: RpcServer.reader=7,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: FifoRpcScheduler.handler5-thread-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:374) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: org.apache.hadoop.hdfs.LeaseRenewer$1@447bd8da java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.LeaseRenewer.run(LeaseRenewer.java:397) org.apache.hadoop.hdfs.LeaseRenewer.access$600(LeaseRenewer.java:69) org.apache.hadoop.hdfs.LeaseRenewer$1.run(LeaseRenewer.java:273) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.DecommissionManager$Monitor@592fa55f java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.DecommissionManager$Monitor.run(DecommissionManager.java:65) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: RpcServer.reader=9,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: IPC Server Responder sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.hadoop.ipc.Server$Responder.run(Server.java:645) Potentially hanging thread: FifoRpcScheduler.handler5-thread-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:374) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: SessionTracker java.lang.Object.wait(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146) Potentially hanging thread: AM.ZK.Worker-pool15-t4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: RpcServer.reader=6,port=48976 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:570) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:556) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: SyncThread:0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:97) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.FSNamesystem$HeartbeatMonitor@76f3da25 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.FSNamesystem$HeartbeatMonitor.run(FSNamesystem.java:3146) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: M:0;kiyo:48976 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:56) org.apache.hadoop.hbase.master.HMaster.loop(HMaster.java:737) org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:607) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: htable-pool32-t1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: Thread-204-SendThread(localhost:56427) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) Potentially hanging thread: AM.ZK.Worker-pool15-t3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: AM.ZK.Worker-pool15-t20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: SplitLogWorker-kiyo.gq1.ygridcore.net,60181,1391628487831-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) Potentially hanging thread: IPC Server handler 0 on 43029 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.ipc.Server$Handler.run(Server.java:1408) Potentially hanging thread: NIOServerCxn.Factory:0.0.0.0/0.0.0.0:56427 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178) java.lang.Thread.run(Thread.java:724) Potentially hanging thread: snapshot-log-cleaner-cache-refresher java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataNode: [/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data3,/homes/hortonzy/98/hbase-server/target/test-data/ca39b777-d5fe-4aaa-93d8-c1c17cfe2676/dfscluster_595717bc-2915-40f5-b2df-7a7d823bd295/dfs/data/data4] java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.DataNode.offerService(DataNode.java:1149) org.apache.hadoop.hdfs.server.datanode.DataNode.run(DataNode.java:1588) java.lang.Thread.run(Thread.java:724) - Thread LEAK? -, OpenFileDescriptor=236 (was 154) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=32768 (was 32768), SystemLoadAverage=304 (was 514), ProcessCount=460 (was 460), AvailableMemoryMB=4761 (was 4525) - AvailableMemoryMB LEAK? -, ConnectionCount=4 (was 0) - ConnectionCount LEAK? - 2014-02-05 19:29:01,634 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(2140): Can't move 1588230740, there is no destination server available. 2014-02-05 19:29:01,634 WARN [MASTER_META_SERVER_OPERATIONS-kiyo:48976-0] master.AssignmentManager(1863): Unable to determine a plan to assign {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-02-05 19:29:01,640 DEBUG [htable-pool32-t2] zookeeper.ZKUtil(687): hconnection-0x4fc6bde5-0x144038588cb000c, quorum=localhost:56427, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error)