2014-06-15 07:45:35,661 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(837): Starting up minicluster with 1 master(s) and 2 regionserver(s) and 2 datanode(s) 2014-06-15 07:45:35,729 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(394): Created new mini-cluster data directory: /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa, deleteOnExit=true 2014-06-15 07:45:35,729 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(624): Setting test.cache.data to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/cache_data in system properties and HBase conf 2014-06-15 07:45:35,730 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(624): Setting hadoop.tmp.dir to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/hadoop_tmp in system properties and HBase conf 2014-06-15 07:45:35,731 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(624): Setting hadoop.log.dir to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/hadoop_logs in system properties and HBase conf 2014-06-15 07:45:35,731 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(624): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/mapred_local in system properties and HBase conf 2014-06-15 07:45:35,732 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(624): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/mapred_temp in system properties and HBase conf 2014-06-15 07:45:35,733 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(615): read short circuit is OFF 2014-06-15 07:45:35,961 WARN [pool-1-thread-1] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2014-06-15 07:45:36,230 DEBUG [pool-1-thread-1] fs.HFileSystem(221): The file system is not a DistributedFileSystem. Skipping on block location reordering Formatting using clusterid: testClusterID 2014-06-15 07:45:37,650 WARN [pool-1-thread-1] impl.MetricsConfig(124): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2014-06-15 07:45:37,854 INFO [pool-1-thread-1] log.Slf4jLog(67): Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2014-06-15 07:45:37,940 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2014-06-15 07:45:37,975 INFO [pool-1-thread-1] log.Slf4jLog(67): Extract jar:file:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.0/hadoop-hdfs-2.4.0-tests.jar!/webapps/hdfs to /tmp/Jetty_localhost_57419_hdfs____ind4is/webapp 2014-06-15 07:45:38,275 WARN [pool-1-thread-1] server.AuthenticationFilter(162): 'signature.secret' configuration not set, using a random value as secret 2014-06-15 07:45:38,364 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@localhost:57419 2014-06-15 07:45:39,656 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2014-06-15 07:45:39,663 INFO [pool-1-thread-1] log.Slf4jLog(67): Extract jar:file:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.0/hadoop-hdfs-2.4.0-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_58778_datanode____.pvky4k/webapp 2014-06-15 07:45:39,818 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@localhost:58778 2014-06-15 07:45:39,942 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2014-06-15 07:45:39,964 INFO [pool-1-thread-1] log.Slf4jLog(67): Extract jar:file:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.0/hadoop-hdfs-2.4.0-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_59014_datanode____2si07q/webapp 2014-06-15 07:45:40,121 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@localhost:59014 2014-06-15 07:45:40,838 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(1712): BLOCK* processReport: from storage DS-f230c240-7ce4-42bc-baed-86a674515d5d node DatanodeRegistration(127.0.0.1, datanodeUuid=ad7bf8ed-5f16-4159-9c77-68d42e13c945, infoPort=58778, ipcPort=38185, storageInfo=lv=-55;cid=testClusterID;nsid=516573808;c=0), blocks: 0, processing time: 4 msecs 2014-06-15 07:45:40,838 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(1712): BLOCK* processReport: from storage DS-544f3538-0c32-45fd-827a-36158c74ea12 node DatanodeRegistration(127.0.0.1, datanodeUuid=aeb84a8a-307e-488c-b1d3-72ea0c2529e7, infoPort=59014, ipcPort=46263, storageInfo=lv=-55;cid=testClusterID;nsid=516573808;c=0), blocks: 0, processing time: 2 msecs 2014-06-15 07:45:40,838 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(1712): BLOCK* processReport: from storage DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd node DatanodeRegistration(127.0.0.1, datanodeUuid=ad7bf8ed-5f16-4159-9c77-68d42e13c945, infoPort=58778, ipcPort=38185, storageInfo=lv=-55;cid=testClusterID;nsid=516573808;c=0), blocks: 0, processing time: 0 msecs 2014-06-15 07:45:40,838 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(1712): BLOCK* processReport: from storage DS-70369760-5da5-47d1-98df-a3638d877733 node DatanodeRegistration(127.0.0.1, datanodeUuid=aeb84a8a-307e-488c-b1d3-72ea0c2529e7, infoPort=59014, ipcPort=46263, storageInfo=lv=-55;cid=testClusterID;nsid=516573808;c=0), blocks: 0, processing time: 0 msecs 2014-06-15 07:45:41,006 INFO [pool-1-thread-1] zookeeper.MiniZooKeeperCluster(199): Started MiniZK Cluster and connect 1 ZK server on client port: 53967 2014-06-15 07:45:41,675 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:41,687 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741825_1001 size 7 2014-06-15 07:45:41,691 DEBUG [pool-1-thread-1] util.FSUtils(638): Created version file at hdfs://localhost:37161/user/jenkins/hbase with version=8 2014-06-15 07:45:41,807 INFO [pool-1-thread-1] client.ConnectionUtils(97): master/asf008.sp2.ygridcore.net/67.195.138.23:0 server-side HConnection retries=350 2014-06-15 07:45:42,001 DEBUG [pool-1-thread-1] ipc.SimpleRpcScheduler(122): Using deadline as user call queue 2014-06-15 07:45:42,039 INFO [pool-1-thread-1] hfile.CacheConfig(508): Allocating LruBlockCache size=675.58 MB, blockSize=64 KB 2014-06-15 07:45:42,043 INFO [pool-1-thread-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:42,062 INFO [pool-1-thread-1] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-06-15 07:45:42,106 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=master:45812 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:42,158 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:42,160 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): master:45812-0x1469e7d286a0000 connected 2014-06-15 07:45:42,199 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2014-06-15 07:45:42,200 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-06-15 07:45:42,212 INFO [pool-1-thread-1] http.HttpRequestLog(69): Http request log for http.requests.master is not defined 2014-06-15 07:45:42,213 INFO [pool-1-thread-1] http.HttpServer(816): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2014-06-15 07:45:42,215 INFO [pool-1-thread-1] http.HttpServer(794): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2014-06-15 07:45:42,215 INFO [pool-1-thread-1] http.HttpServer(801): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-06-15 07:45:42,215 INFO [pool-1-thread-1] http.HttpServer(801): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2014-06-15 07:45:42,220 INFO [pool-1-thread-1] http.HttpServer(1008): Jetty bound to port 45504 2014-06-15 07:45:42,220 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2014-06-15 07:45:42,274 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:45504 2014-06-15 07:45:42,275 INFO [pool-1-thread-1] master.HMaster(271): hbase.rootdir=hdfs://localhost:37161/user/jenkins/hbase, hbase.cluster.distributed=false 2014-06-15 07:45:42,285 INFO [pool-1-thread-1] master.HMaster(1238): Adding ZNode for /hbase/backup-masters/asf008.sp2.ygridcore.net,45812,1402818342029 in backup master directory 2014-06-15 07:45:42,294 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:42,309 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2014-06-15 07:45:42,310 DEBUG [ActiveMasterManager] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-06-15 07:45:42,313 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-06-15 07:45:42,313 DEBUG [pool-1-thread-1-EventThread] master.ActiveMasterManager(120): A master is now available 2014-06-15 07:45:42,315 INFO [ActiveMasterManager] master.ActiveMasterManager(164): Deleting ZNode for /hbase/backup-masters/asf008.sp2.ygridcore.net,45812,1402818342029 from backup master directory 2014-06-15 07:45:42,318 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:42,319 WARN [ActiveMasterManager] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-06-15 07:45:42,319 INFO [ActiveMasterManager] master.ActiveMasterManager(173): Registered Active Master=asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:42,375 INFO [pool-1-thread-1] client.ConnectionUtils(97): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0 server-side HConnection retries=350 2014-06-15 07:45:42,375 DEBUG [pool-1-thread-1] ipc.SimpleRpcScheduler(122): Using deadline as user call queue 2014-06-15 07:45:42,381 INFO [pool-1-thread-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:42,384 INFO [pool-1-thread-1] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-06-15 07:45:42,392 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=regionserver:57332 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:42,395 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:42,397 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): regionserver:57332, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-06-15 07:45:42,399 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(431): regionserver:57332, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-06-15 07:45:42,399 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): regionserver:57332-0x1469e7d286a0001 connected 2014-06-15 07:45:42,405 INFO [pool-1-thread-1] http.HttpRequestLog(69): Http request log for http.requests.regionserver is not defined 2014-06-15 07:45:42,406 INFO [pool-1-thread-1] http.HttpServer(816): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2014-06-15 07:45:42,407 INFO [pool-1-thread-1] http.HttpServer(794): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2014-06-15 07:45:42,407 INFO [pool-1-thread-1] http.HttpServer(801): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-06-15 07:45:42,407 INFO [pool-1-thread-1] http.HttpServer(801): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2014-06-15 07:45:42,410 INFO [pool-1-thread-1] http.HttpServer(1008): Jetty bound to port 40549 2014-06-15 07:45:42,410 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2014-06-15 07:45:42,437 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:40549 2014-06-15 07:45:42,444 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:42,447 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:42,450 DEBUG [ActiveMasterManager] util.FSUtils(777): Created cluster ID file at hdfs://localhost:37161/user/jenkins/hbase/hbase.id with ID: 9bacc67e-8236-45bc-afb5-4c29df50e7c4 2014-06-15 07:45:42,484 INFO [ActiveMasterManager] master.MasterFileSystem(525): BOOTSTRAP: creating hbase:meta region 2014-06-15 07:45:42,488 INFO [pool-1-thread-1] client.ConnectionUtils(97): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0 server-side HConnection retries=350 2014-06-15 07:45:42,489 DEBUG [pool-1-thread-1] ipc.SimpleRpcScheduler(122): Using deadline as user call queue 2014-06-15 07:45:42,492 INFO [pool-1-thread-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:42,495 INFO [pool-1-thread-1] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-06-15 07:45:42,501 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=regionserver:47197 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:42,505 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:42,506 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): regionserver:47197, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-06-15 07:45:42,507 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): regionserver:47197-0x1469e7d286a0002 connected 2014-06-15 07:45:42,508 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-06-15 07:45:42,530 INFO [pool-1-thread-1] http.HttpRequestLog(69): Http request log for http.requests.regionserver is not defined 2014-06-15 07:45:42,531 INFO [pool-1-thread-1] http.HttpServer(816): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2014-06-15 07:45:42,532 INFO [pool-1-thread-1] http.HttpServer(794): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2014-06-15 07:45:42,532 INFO [pool-1-thread-1] http.HttpServer(801): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2014-06-15 07:45:42,533 INFO [pool-1-thread-1] http.HttpServer(801): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-06-15 07:45:42,534 INFO [pool-1-thread-1] http.HttpServer(1008): Jetty bound to port 37302 2014-06-15 07:45:42,534 INFO [pool-1-thread-1] log.Slf4jLog(67): jetty-6.1.26 2014-06-15 07:45:42,549 INFO [ActiveMasterManager] regionserver.HRegion(4277): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '10', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '8192', IN_MEMORY => 'false', BLOCKCACHE => 'false'} RootDir = hdfs://localhost:37161/user/jenkins/hbase Table name == hbase:meta 2014-06-15 07:45:42,569 INFO [pool-1-thread-1] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:37302 2014-06-15 07:45:42,588 DEBUG [M:0;asf008:45812] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-06-15 07:45:42,592 DEBUG [RS:1;asf008:47197] zookeeper.ZKUtil(429): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-06-15 07:45:42,592 DEBUG [RS:0;asf008:57332] zookeeper.ZKUtil(429): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-06-15 07:45:42,607 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:42,609 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:42,624 INFO [ActiveMasterManager] wal.FSHLog(447): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, prefix=hlog, logDir=hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/WALs, oldLogDir=hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/oldWALs 2014-06-15 07:45:42,673 INFO [ActiveMasterManager] wal.FSHLog(888): New WAL /user/jenkins/hbase/data/hbase/meta/1588230740/WALs/hlog.1402818342633 2014-06-15 07:45:42,721 DEBUG [ActiveMasterManager] regionserver.HRegion(646): Instantiated hbase:meta,,1.1588230740 2014-06-15 07:45:42,786 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:42,793 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:42,796 DEBUG [StoreOpener-1588230740-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/info 2014-06-15 07:45:42,801 DEBUG [StoreOpener-1588230740-1] util.ChecksumType$2(68): Checksum using org.apache.hadoop.util.PureJavaCrc32 2014-06-15 07:45:42,801 DEBUG [StoreOpener-1588230740-1] util.ChecksumType$3(111): Checksum can use org.apache.hadoop.util.PureJavaCrc32C 2014-06-15 07:45:42,806 DEBUG [ActiveMasterManager] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740 2014-06-15 07:45:42,817 INFO [ActiveMasterManager] regionserver.HRegion(747): Onlined 1588230740; next sequenceid=2 2014-06-15 07:45:42,818 DEBUG [ActiveMasterManager] regionserver.HRegion(1116): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2014-06-15 07:45:42,819 DEBUG [ActiveMasterManager] regionserver.HRegion(1143): Updates disabled for region hbase:meta,,1.1588230740 2014-06-15 07:45:42,822 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(758): Closed info 2014-06-15 07:45:42,823 INFO [ActiveMasterManager] regionserver.HRegion(1225): Closed hbase:meta,,1.1588230740 2014-06-15 07:45:42,823 DEBUG [ActiveMasterManager] wal.FSHLog(1059): Closing WAL writer in hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/WALs 2014-06-15 07:45:42,863 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 9 2014-06-15 07:45:42,864 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741828_1004 size 17 2014-06-15 07:45:42,888 DEBUG [ActiveMasterManager] wal.FSHLog(1015): Moved 1 WAL file(s) to /user/jenkins/hbase/data/hbase/meta/1588230740/oldWALs 2014-06-15 07:45:42,939 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:42,940 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:42,973 DEBUG [ActiveMasterManager] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:42,982 INFO [ActiveMasterManager] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-06-15 07:45:42,989 DEBUG [ActiveMasterManager] master.SplitLogManager(1346): Distributed log replay=false, hfile.format.version=3 2014-06-15 07:45:42,993 INFO [ActiveMasterManager] master.SplitLogManager(216): Timeout=120000, unassigned timeout=180000, distributedLogReplay=false 2014-06-15 07:45:42,994 INFO [ActiveMasterManager] master.SplitLogManager(1091): Found 0 orphan tasks and 0 rescan nodes 2014-06-15 07:45:43,052 INFO [ActiveMasterManager] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0xd2bee connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,054 DEBUG [ActiveMasterManager-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0xd2bee, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,055 DEBUG [ActiveMasterManager-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0xd2bee-0x1469e7d286a0003 connected 2014-06-15 07:45:43,068 DEBUG [ActiveMasterManager] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=org.apache.hadoop.hbase.client.ConnectionUtils$1@1fe8714, zookeeper=master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:43,069 DEBUG [ActiveMasterManager] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/meta-region-server 2014-06-15 07:45:43,090 DEBUG [ActiveMasterManager] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2014-06-15 07:45:43,116 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-06-15 07:45:43,116 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-06-15 07:45:43,117 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-06-15 07:45:43,118 INFO [ActiveMasterManager] master.HMaster(431): Server active/primary master=asf008.sp2.ygridcore.net,45812,1402818342029, sessionid=0x1469e7d286a0000, setting cluster-up flag (Was=false) 2014-06-15 07:45:43,120 INFO [RS:0;asf008:57332] regionserver.HRegionServer(621): ClusterId : 9bacc67e-8236-45bc-afb5-4c29df50e7c4 2014-06-15 07:45:43,121 INFO [RS:1;asf008:47197] regionserver.HRegionServer(621): ClusterId : 9bacc67e-8236-45bc-afb5-4c29df50e7c4 2014-06-15 07:45:43,121 INFO [M:0;asf008:45812] regionserver.HRegionServer(621): ClusterId : 9bacc67e-8236-45bc-afb5-4c29df50e7c4 2014-06-15 07:45:43,124 INFO [RS:0;asf008:57332] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x1102fab connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,129 DEBUG [RS:0;asf008:57332-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x1102fab, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,130 DEBUG [RS:0;asf008:57332-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x1102fab-0x1469e7d286a0004 connected 2014-06-15 07:45:43,131 DEBUG [M:0;asf008:45812] procedure.RegionServerProcedureManagerHost(44): Procedure online-snapshot is initializing 2014-06-15 07:45:43,132 DEBUG [RS:0;asf008:57332] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=org.apache.hadoop.hbase.client.ConnectionUtils$1@a06e8d, zookeeper=regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:43,136 DEBUG [RS:0;asf008:57332] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/meta-region-server 2014-06-15 07:45:43,136 INFO [RS:1;asf008:47197] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x562791 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,136 DEBUG [RS:0;asf008:57332] procedure.RegionServerProcedureManagerHost(44): Procedure online-snapshot is initializing 2014-06-15 07:45:43,145 DEBUG [RS:1;asf008:47197-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x562791, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,145 DEBUG [RS:0;asf008:57332] zookeeper.RecoverableZooKeeper(508): Node /hbase/online-snapshot already exists 2014-06-15 07:45:43,146 DEBUG [RS:1;asf008:47197-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x562791-0x1469e7d286a0005 connected 2014-06-15 07:45:43,147 DEBUG [RS:1;asf008:47197] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=org.apache.hadoop.hbase.client.ConnectionUtils$1@19853c2, zookeeper=regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:43,148 DEBUG [RS:1;asf008:47197] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/meta-region-server 2014-06-15 07:45:43,148 DEBUG [RS:0;asf008:57332] zookeeper.RecoverableZooKeeper(508): Node /hbase/online-snapshot/acquired already exists 2014-06-15 07:45:43,149 DEBUG [RS:1;asf008:47197] procedure.RegionServerProcedureManagerHost(44): Procedure online-snapshot is initializing 2014-06-15 07:45:43,152 DEBUG [RS:1;asf008:47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/online-snapshot/acquired already exists 2014-06-15 07:45:43,153 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper(508): Node /hbase/online-snapshot/acquired already exists 2014-06-15 07:45:43,154 DEBUG [RS:0;asf008:57332] zookeeper.RecoverableZooKeeper(508): Node /hbase/online-snapshot/abort already exists 2014-06-15 07:45:43,155 DEBUG [M:0;asf008:45812] procedure.RegionServerProcedureManagerHost(46): Procedure online-snapshot is initialized 2014-06-15 07:45:43,155 DEBUG [M:0;asf008:45812] procedure.RegionServerProcedureManagerHost(44): Procedure flush-table-proc is initializing 2014-06-15 07:45:43,155 DEBUG [RS:0;asf008:57332] procedure.RegionServerProcedureManagerHost(46): Procedure online-snapshot is initialized 2014-06-15 07:45:43,155 DEBUG [RS:0;asf008:57332] procedure.RegionServerProcedureManagerHost(44): Procedure flush-table-proc is initializing 2014-06-15 07:45:43,156 INFO [ActiveMasterManager] procedure.ZKProcedureUtil(256): Clearing all procedure znodes: /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2014-06-15 07:45:43,158 DEBUG [RS:1;asf008:47197] procedure.RegionServerProcedureManagerHost(46): Procedure online-snapshot is initialized 2014-06-15 07:45:43,158 DEBUG [RS:1;asf008:47197] procedure.RegionServerProcedureManagerHost(44): Procedure flush-table-proc is initializing 2014-06-15 07:45:43,161 DEBUG [RS:0;asf008:57332] zookeeper.RecoverableZooKeeper(508): Node /hbase/flush-table-proc already exists 2014-06-15 07:45:43,162 DEBUG [M:0;asf008:45812] zookeeper.RecoverableZooKeeper(508): Node /hbase/flush-table-proc/acquired already exists 2014-06-15 07:45:43,163 DEBUG [RS:0;asf008:57332] zookeeper.RecoverableZooKeeper(508): Node /hbase/flush-table-proc/acquired already exists 2014-06-15 07:45:43,163 DEBUG [ActiveMasterManager] procedure.ZKProcedureCoordinatorRpcs(239): Starting the controller for procedure member:asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,166 DEBUG [RS:0;asf008:57332] zookeeper.RecoverableZooKeeper(508): Node /hbase/flush-table-proc/reached already exists 2014-06-15 07:45:43,166 DEBUG [M:0;asf008:45812] zookeeper.RecoverableZooKeeper(508): Node /hbase/flush-table-proc/reached already exists 2014-06-15 07:45:43,170 DEBUG [M:0;asf008:45812] procedure.RegionServerProcedureManagerHost(46): Procedure flush-table-proc is initialized 2014-06-15 07:45:43,170 DEBUG [RS:0;asf008:57332] procedure.RegionServerProcedureManagerHost(46): Procedure flush-table-proc is initialized 2014-06-15 07:45:43,170 DEBUG [RS:1;asf008:47197] procedure.RegionServerProcedureManagerHost(46): Procedure flush-table-proc is initialized 2014-06-15 07:45:43,171 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper(508): Node /hbase/flush-table-proc/acquired already exists 2014-06-15 07:45:43,173 INFO [ActiveMasterManager] procedure.ZKProcedureUtil(256): Clearing all procedure znodes: /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:43,174 INFO [M:0;asf008:45812] regionserver.MemStoreFlusher(127): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2014-06-15 07:45:43,175 INFO [RS:0;asf008:57332] regionserver.MemStoreFlusher(127): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2014-06-15 07:45:43,174 INFO [RS:1;asf008:47197] regionserver.MemStoreFlusher(127): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2014-06-15 07:45:43,177 DEBUG [ActiveMasterManager] procedure.ZKProcedureCoordinatorRpcs(239): Starting the controller for procedure member:asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,180 INFO [M:0;asf008:45812] regionserver.HRegionServer$CompactionChecker(1286): CompactionChecker runs every 1sec 2014-06-15 07:45:43,180 INFO [RS:1;asf008:47197] regionserver.HRegionServer$CompactionChecker(1286): CompactionChecker runs every 1sec 2014-06-15 07:45:43,180 INFO [RS:0;asf008:57332] regionserver.HRegionServer$CompactionChecker(1286): CompactionChecker runs every 1sec 2014-06-15 07:45:43,190 DEBUG [RS:0;asf008:57332] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:0;asf008:57332 2014-06-15 07:45:43,190 DEBUG [RS:1;asf008:47197] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:1;asf008:47197 2014-06-15 07:45:43,193 DEBUG [M:0;asf008:45812] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:M:0;asf008:45812 2014-06-15 07:45:43,195 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-06-15 07:45:43,207 DEBUG [RS:0;asf008:57332] zookeeper.ZKUtil(429): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,208 DEBUG [RS:1;asf008:47197] zookeeper.ZKUtil(429): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,211 DEBUG [M:0;asf008:45812] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,212 INFO [M:0;asf008:45812] regionserver.HRegionServer(1970): reportForDuty to master=asf008.sp2.ygridcore.net,45812,1402818342029 with port=45812, startcode=1402818342029 2014-06-15 07:45:43,212 INFO [RS:0;asf008:57332] regionserver.HRegionServer(1970): reportForDuty to master=asf008.sp2.ygridcore.net,45812,1402818342029 with port=57332, startcode=1402818342381 2014-06-15 07:45:43,212 INFO [RS:1;asf008:47197] regionserver.HRegionServer(1970): reportForDuty to master=asf008.sp2.ygridcore.net,45812,1402818342029 with port=47197, startcode=1402818342492 2014-06-15 07:45:43,213 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,214 DEBUG [ActiveMasterManager] master.HMaster(1773): Registered master coprocessor service: service=VisibilityLabelsService 2014-06-15 07:45:43,216 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,217 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,219 DEBUG [M:0;asf008:45812] regionserver.HRegionServer(1986): Master is not running yet 2014-06-15 07:45:43,219 DEBUG [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(92): RS node: /hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 data: PBUF?? 2014-06-15 07:45:43,219 WARN [M:0;asf008:45812] regionserver.HRegionServer(737): reportForDuty failed; sleeping and then retrying. 2014-06-15 07:45:43,224 DEBUG [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(92): RS node: /hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 data: PBUF?? 2014-06-15 07:45:43,226 DEBUG [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(92): RS node: /hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 data: PBUF? 2014-06-15 07:45:43,229 DEBUG [ActiveMasterManager] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/visibility/labels 2014-06-15 07:45:43,230 DEBUG [ActiveMasterManager] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/visibility/user_auths 2014-06-15 07:45:43,230 INFO [ActiveMasterManager] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:43,235 DEBUG [ActiveMasterManager] executor.ExecutorService(99): Starting executor service name=MASTER_OPEN_REGION-asf008:45812, corePoolSize=5, maxPoolSize=5 2014-06-15 07:45:43,236 DEBUG [ActiveMasterManager] executor.ExecutorService(99): Starting executor service name=MASTER_CLOSE_REGION-asf008:45812, corePoolSize=5, maxPoolSize=5 2014-06-15 07:45:43,236 DEBUG [ActiveMasterManager] executor.ExecutorService(99): Starting executor service name=MASTER_SERVER_OPERATIONS-asf008:45812, corePoolSize=5, maxPoolSize=5 2014-06-15 07:45:43,236 DEBUG [ActiveMasterManager] executor.ExecutorService(99): Starting executor service name=MASTER_META_SERVER_OPERATIONS-asf008:45812, corePoolSize=5, maxPoolSize=5 2014-06-15 07:45:43,236 DEBUG [ActiveMasterManager] executor.ExecutorService(99): Starting executor service name=M_LOG_REPLAY_OPS-asf008:45812, corePoolSize=10, maxPoolSize=10 2014-06-15 07:45:43,236 DEBUG [ActiveMasterManager] executor.ExecutorService(99): Starting executor service name=MASTER_TABLE_OPERATIONS-asf008:45812, corePoolSize=1, maxPoolSize=1 2014-06-15 07:45:43,239 DEBUG [ActiveMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2014-06-15 07:45:43,243 INFO [ActiveMasterManager] zookeeper.RecoverableZooKeeper(120): Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,246 DEBUG [ActiveMasterManager-EventThread] zookeeper.ZooKeeperWatcher(311): replicationLogCleaner, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,249 DEBUG [ActiveMasterManager-EventThread] zookeeper.ZooKeeperWatcher(395): replicationLogCleaner-0x1469e7d286a0006 connected 2014-06-15 07:45:43,262 DEBUG [ActiveMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2014-06-15 07:45:43,266 DEBUG [ActiveMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotLogCleaner 2014-06-15 07:45:43,268 DEBUG [ActiveMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2014-06-15 07:45:43,271 DEBUG [ActiveMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2014-06-15 07:45:43,272 DEBUG [ActiveMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2014-06-15 07:45:43,273 INFO [M:0;asf008:45812] regionserver.HRegionServer(1970): reportForDuty to master=asf008.sp2.ygridcore.net,45812,1402818342029 with port=45812, startcode=1402818342029 2014-06-15 07:45:43,273 INFO [ActiveMasterManager] master.ServerManager(939): Waiting for region servers count to settle; currently checked in 0, slept for 0 ms, expecting minimum of 2, maximum of 2, timeout of 4500 ms, interval of 1500 ms. 2014-06-15 07:45:43,283 INFO [M:0;asf008:45812] master.ServerManager(423): Registering server=asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,289 INFO [M:0;asf008:45812] regionserver.HRegionServer(1123): Config from master: hbase.rootdir=hdfs://localhost:37161/user/jenkins/hbase 2014-06-15 07:45:43,289 INFO [M:0;asf008:45812] regionserver.HRegionServer(1123): Config from master: fs.defaultFS=hdfs://localhost:37161 2014-06-15 07:45:43,289 INFO [M:0;asf008:45812] regionserver.HRegionServer(1123): Config from master: hbase.master.info.port=45504 2014-06-15 07:45:43,289 WARN [M:0;asf008:45812] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-06-15 07:45:43,289 DEBUG [M:0;asf008:45812] regionserver.HRegionServer(1383): logdir=hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,302 INFO [RpcServer.handler=0,port=45812] master.ServerManager(423): Registering server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,303 INFO [RpcServer.handler=1,port=45812] master.ServerManager(423): Registering server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,314 INFO [RS:1;asf008:47197] regionserver.HRegionServer(1123): Config from master: hbase.rootdir=hdfs://localhost:37161/user/jenkins/hbase 2014-06-15 07:45:43,315 INFO [RS:0;asf008:57332] regionserver.HRegionServer(1123): Config from master: hbase.rootdir=hdfs://localhost:37161/user/jenkins/hbase 2014-06-15 07:45:43,315 INFO [RS:1;asf008:47197] regionserver.HRegionServer(1123): Config from master: fs.defaultFS=hdfs://localhost:37161 2014-06-15 07:45:43,315 INFO [RS:0;asf008:57332] regionserver.HRegionServer(1123): Config from master: fs.defaultFS=hdfs://localhost:37161 2014-06-15 07:45:43,315 DEBUG [M:0;asf008:45812] regionserver.Replication(140): ReplicationStatisticsThread 300 2014-06-15 07:45:43,315 INFO [RS:0;asf008:57332] regionserver.HRegionServer(1123): Config from master: hbase.master.info.port=45504 2014-06-15 07:45:43,315 INFO [RS:1;asf008:47197] regionserver.HRegionServer(1123): Config from master: hbase.master.info.port=45504 2014-06-15 07:45:43,316 WARN [RS:0;asf008:57332] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-06-15 07:45:43,316 WARN [RS:1;asf008:47197] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-06-15 07:45:43,316 DEBUG [RS:0;asf008:57332] regionserver.HRegionServer(1383): logdir=hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,316 DEBUG [RS:1;asf008:47197] regionserver.HRegionServer(1383): logdir=hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,317 INFO [M:0;asf008:45812] wal.FSHLog(447): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, prefix=asf008.sp2.ygridcore.net%2C45812%2C1402818342029, logDir=hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029, oldLogDir=hdfs://localhost:37161/user/jenkins/hbase/oldWALs 2014-06-15 07:45:43,326 INFO [ActiveMasterManager] master.ServerManager(958): Finished waiting for region servers count to settle; checked in 3, slept for 53 ms, expecting minimum of 2, maximum of 2, master is running. 2014-06-15 07:45:43,329 INFO [ActiveMasterManager] master.MasterFileSystem(258): Log folder hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029 belongs to an existing region server 2014-06-15 07:45:43,330 DEBUG [RS:1;asf008:47197] regionserver.Replication(140): ReplicationStatisticsThread 300 2014-06-15 07:45:43,331 INFO [RS:1;asf008:47197] wal.FSHLog(447): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, prefix=asf008.sp2.ygridcore.net%2C47197%2C1402818342492, logDir=hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,47197,1402818342492, oldLogDir=hdfs://localhost:37161/user/jenkins/hbase/oldWALs 2014-06-15 07:45:43,332 DEBUG [RS:0;asf008:57332] regionserver.Replication(140): ReplicationStatisticsThread 300 2014-06-15 07:45:43,332 INFO [RS:0;asf008:57332] wal.FSHLog(447): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, prefix=asf008.sp2.ygridcore.net%2C57332%2C1402818342381, logDir=hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,57332,1402818342381, oldLogDir=hdfs://localhost:37161/user/jenkins/hbase/oldWALs 2014-06-15 07:45:43,365 INFO [M:0;asf008:45812] wal.FSHLog(888): New WAL /user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029/asf008.sp2.ygridcore.net%2C45812%2C1402818342029.1402818343327 2014-06-15 07:45:43,377 INFO [M:0;asf008:45812] regionserver.MetricsRegionServerWrapperImpl(89): Computing regionserver metrics every 5000 milliseconds 2014-06-15 07:45:43,391 DEBUG [M:0;asf008:45812] executor.ExecutorService(99): Starting executor service name=RS_OPEN_REGION-asf008:45812, corePoolSize=3, maxPoolSize=3 2014-06-15 07:45:43,391 DEBUG [M:0;asf008:45812] executor.ExecutorService(99): Starting executor service name=RS_OPEN_META-asf008:45812, corePoolSize=1, maxPoolSize=1 2014-06-15 07:45:43,392 DEBUG [M:0;asf008:45812] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_REGION-asf008:45812, corePoolSize=3, maxPoolSize=3 2014-06-15 07:45:43,392 DEBUG [M:0;asf008:45812] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_META-asf008:45812, corePoolSize=1, maxPoolSize=1 2014-06-15 07:45:43,392 DEBUG [M:0;asf008:45812] executor.ExecutorService(99): Starting executor service name=RS_LOG_REPLAY_OPS-asf008:45812, corePoolSize=2, maxPoolSize=2 2014-06-15 07:45:43,393 INFO [RS:0;asf008:57332] wal.FSHLog(888): New WAL /user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,57332,1402818342381/asf008.sp2.ygridcore.net%2C57332%2C1402818342381.1402818343342 2014-06-15 07:45:43,395 INFO [RS:1;asf008:47197] wal.FSHLog(888): New WAL /user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,47197,1402818342492/asf008.sp2.ygridcore.net%2C47197%2C1402818342492.1402818343340 2014-06-15 07:45:43,397 INFO [RS:0;asf008:57332] regionserver.MetricsRegionServerWrapperImpl(89): Computing regionserver metrics every 5000 milliseconds 2014-06-15 07:45:43,398 INFO [RS:1;asf008:47197] regionserver.MetricsRegionServerWrapperImpl(89): Computing regionserver metrics every 5000 milliseconds 2014-06-15 07:45:43,399 DEBUG [M:0;asf008:45812] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,399 DEBUG [RS:0;asf008:57332] executor.ExecutorService(99): Starting executor service name=RS_OPEN_REGION-asf008:57332, corePoolSize=3, maxPoolSize=3 2014-06-15 07:45:43,400 DEBUG [RS:0;asf008:57332] executor.ExecutorService(99): Starting executor service name=RS_OPEN_META-asf008:57332, corePoolSize=1, maxPoolSize=1 2014-06-15 07:45:43,400 DEBUG [M:0;asf008:45812] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,400 DEBUG [RS:0;asf008:57332] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_REGION-asf008:57332, corePoolSize=3, maxPoolSize=3 2014-06-15 07:45:43,400 DEBUG [RS:1;asf008:47197] executor.ExecutorService(99): Starting executor service name=RS_OPEN_REGION-asf008:47197, corePoolSize=3, maxPoolSize=3 2014-06-15 07:45:43,400 DEBUG [RS:0;asf008:57332] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_META-asf008:57332, corePoolSize=1, maxPoolSize=1 2014-06-15 07:45:43,400 DEBUG [RS:1;asf008:47197] executor.ExecutorService(99): Starting executor service name=RS_OPEN_META-asf008:47197, corePoolSize=1, maxPoolSize=1 2014-06-15 07:45:43,401 DEBUG [RS:0;asf008:57332] executor.ExecutorService(99): Starting executor service name=RS_LOG_REPLAY_OPS-asf008:57332, corePoolSize=2, maxPoolSize=2 2014-06-15 07:45:43,401 DEBUG [RS:1;asf008:47197] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_REGION-asf008:47197, corePoolSize=3, maxPoolSize=3 2014-06-15 07:45:43,401 DEBUG [RS:1;asf008:47197] executor.ExecutorService(99): Starting executor service name=RS_CLOSE_META-asf008:47197, corePoolSize=1, maxPoolSize=1 2014-06-15 07:45:43,401 DEBUG [RS:1;asf008:47197] executor.ExecutorService(99): Starting executor service name=RS_LOG_REPLAY_OPS-asf008:47197, corePoolSize=2, maxPoolSize=2 2014-06-15 07:45:43,401 DEBUG [M:0;asf008:45812] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,402 INFO [M:0;asf008:45812] regionserver.ReplicationSourceManager(205): Current list of replicators: [asf008.sp2.ygridcore.net,45812,1402818342029, asf008.sp2.ygridcore.net,47197,1402818342492, asf008.sp2.ygridcore.net,57332,1402818342381] other RSs: [asf008.sp2.ygridcore.net,45812,1402818342029, asf008.sp2.ygridcore.net,47197,1402818342492, asf008.sp2.ygridcore.net,57332,1402818342381] 2014-06-15 07:45:43,404 DEBUG [RS:0;asf008:57332] zookeeper.ZKUtil(429): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,405 DEBUG [RS:0;asf008:57332] zookeeper.ZKUtil(429): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,406 DEBUG [RS:0;asf008:57332] zookeeper.ZKUtil(429): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,406 INFO [RS:0;asf008:57332] regionserver.ReplicationSourceManager(205): Current list of replicators: [asf008.sp2.ygridcore.net,45812,1402818342029, asf008.sp2.ygridcore.net,47197,1402818342492, asf008.sp2.ygridcore.net,57332,1402818342381] other RSs: [asf008.sp2.ygridcore.net,45812,1402818342029, asf008.sp2.ygridcore.net,47197,1402818342492, asf008.sp2.ygridcore.net,57332,1402818342381] 2014-06-15 07:45:43,406 DEBUG [RS:1;asf008:47197] zookeeper.ZKUtil(429): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,410 DEBUG [RS:1;asf008:47197] zookeeper.ZKUtil(429): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,418 DEBUG [RS:1;asf008:47197] zookeeper.ZKUtil(429): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,419 INFO [RS:1;asf008:47197] regionserver.ReplicationSourceManager(205): Current list of replicators: [asf008.sp2.ygridcore.net,45812,1402818342029, asf008.sp2.ygridcore.net,47197,1402818342492, asf008.sp2.ygridcore.net,57332,1402818342381] other RSs: [asf008.sp2.ygridcore.net,45812,1402818342029, asf008.sp2.ygridcore.net,47197,1402818342492, asf008.sp2.ygridcore.net,57332,1402818342381] 2014-06-15 07:45:43,439 INFO [RS:0;asf008:57332] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x4d2125 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,443 DEBUG [RS:0;asf008:57332-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x4d2125, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,443 INFO [M:0;asf008:45812] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x7e9bed connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,446 DEBUG [RS:0;asf008:57332-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x4d2125-0x1469e7d286a0007 connected 2014-06-15 07:45:43,451 DEBUG [M:0;asf008:45812-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x7e9bed, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,452 DEBUG [M:0;asf008:45812-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x7e9bed-0x1469e7d286a0008 connected 2014-06-15 07:45:43,463 INFO [RS:1;asf008:47197] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x1a2335d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,468 DEBUG [RS:1;asf008:47197-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x1a2335d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,470 DEBUG [RS:1;asf008:47197-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x1a2335d-0x1469e7d286a0009 connected 2014-06-15 07:45:43,492 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,57332,1402818342381] regionserver.SplitLogWorker(178): SplitLogWorker asf008.sp2.ygridcore.net,57332,1402818342381 starting 2014-06-15 07:45:43,496 INFO [RS:0;asf008:57332] regionserver.HRegionServer(1144): Serving as asf008.sp2.ygridcore.net,57332,1402818342381, RpcServer on asf008.sp2.ygridcore.net/67.195.138.23:57332, sessionid=0x1469e7d286a0001 2014-06-15 07:45:43,497 DEBUG [RS:0;asf008:57332] procedure.RegionServerProcedureManagerHost(52): Procedure online-snapshot is starting 2014-06-15 07:45:43,497 DEBUG [RS:0;asf008:57332] snapshot.RegionServerSnapshotManager(121): Start Snapshot Manager asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,497 DEBUG [RS:0;asf008:57332] procedure.ZKProcedureMemberRpcs(349): Starting procedure member 'asf008.sp2.ygridcore.net,57332,1402818342381' 2014-06-15 07:45:43,497 DEBUG [RS:0;asf008:57332] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-06-15 07:45:43,501 DEBUG [RS:0;asf008:57332] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-06-15 07:45:43,510 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,57332,1402818342381] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x95868c connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,510 DEBUG [SplitLogWorker-asf008.sp2.ygridcore.net,57332,1402818342381-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x95868c, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,512 DEBUG [SplitLogWorker-asf008.sp2.ygridcore.net,57332,1402818342381-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x95868c-0x1469e7d286a000a connected 2014-06-15 07:45:43,512 DEBUG [RS:0;asf008:57332] procedure.RegionServerProcedureManagerHost(54): Procedure online-snapshot is started 2014-06-15 07:45:43,512 DEBUG [RS:0;asf008:57332] procedure.RegionServerProcedureManagerHost(52): Procedure flush-table-proc is starting 2014-06-15 07:45:43,513 DEBUG [RS:0;asf008:57332] flush.RegionServerFlushTableProcedureManager(100): Start region server flush procedure manager asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:43,513 DEBUG [RS:0;asf008:57332] procedure.ZKProcedureMemberRpcs(349): Starting procedure member 'asf008.sp2.ygridcore.net,57332,1402818342381' 2014-06-15 07:45:43,513 DEBUG [RS:0;asf008:57332] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2014-06-15 07:45:43,514 DEBUG [RS:0;asf008:57332] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:43,515 DEBUG [RS:0;asf008:57332] procedure.RegionServerProcedureManagerHost(54): Procedure flush-table-proc is started 2014-06-15 07:45:43,518 INFO [M:0;asf008:45812] regionserver.HRegionServer(1144): Serving as asf008.sp2.ygridcore.net,45812,1402818342029, RpcServer on asf008.sp2.ygridcore.net/67.195.138.23:45812, sessionid=0x1469e7d286a0000 2014-06-15 07:45:43,519 DEBUG [M:0;asf008:45812] procedure.RegionServerProcedureManagerHost(52): Procedure online-snapshot is starting 2014-06-15 07:45:43,519 DEBUG [M:0;asf008:45812] snapshot.RegionServerSnapshotManager(121): Start Snapshot Manager asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,527 DEBUG [M:0;asf008:45812] procedure.ZKProcedureMemberRpcs(349): Starting procedure member 'asf008.sp2.ygridcore.net,45812,1402818342029' 2014-06-15 07:45:43,527 DEBUG [M:0;asf008:45812] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-06-15 07:45:43,585 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,45812,1402818342029] regionserver.SplitLogWorker(178): SplitLogWorker asf008.sp2.ygridcore.net,45812,1402818342029 starting 2014-06-15 07:45:43,592 INFO [RS:1;asf008:47197] regionserver.HRegionServer(1144): Serving as asf008.sp2.ygridcore.net,47197,1402818342492, RpcServer on asf008.sp2.ygridcore.net/67.195.138.23:47197, sessionid=0x1469e7d286a0002 2014-06-15 07:45:43,602 DEBUG [M:0;asf008:45812] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-06-15 07:45:43,604 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,45812,1402818342029] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x5d8e63 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,605 DEBUG [SplitLogWorker-asf008.sp2.ygridcore.net,45812,1402818342029-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x5d8e63, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,608 DEBUG [M:0;asf008:45812] procedure.RegionServerProcedureManagerHost(54): Procedure online-snapshot is started 2014-06-15 07:45:43,608 DEBUG [M:0;asf008:45812] procedure.RegionServerProcedureManagerHost(52): Procedure flush-table-proc is starting 2014-06-15 07:45:43,608 DEBUG [M:0;asf008:45812] flush.RegionServerFlushTableProcedureManager(100): Start region server flush procedure manager asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:43,608 DEBUG [M:0;asf008:45812] procedure.ZKProcedureMemberRpcs(349): Starting procedure member 'asf008.sp2.ygridcore.net,45812,1402818342029' 2014-06-15 07:45:43,608 DEBUG [M:0;asf008:45812] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2014-06-15 07:45:43,604 DEBUG [RS:1;asf008:47197] procedure.RegionServerProcedureManagerHost(52): Procedure online-snapshot is starting 2014-06-15 07:45:43,598 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,47197,1402818342492] regionserver.SplitLogWorker(178): SplitLogWorker asf008.sp2.ygridcore.net,47197,1402818342492 starting 2014-06-15 07:45:43,609 DEBUG [SplitLogWorker-asf008.sp2.ygridcore.net,45812,1402818342029-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x5d8e63-0x1469e7d286a000b connected 2014-06-15 07:45:43,608 DEBUG [RS:1;asf008:47197] snapshot.RegionServerSnapshotManager(121): Start Snapshot Manager asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,612 DEBUG [M:0;asf008:45812] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:43,613 DEBUG [M:0;asf008:45812] procedure.RegionServerProcedureManagerHost(54): Procedure flush-table-proc is started 2014-06-15 07:45:43,619 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,47197,1402818342492] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x376cc3 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:43,612 DEBUG [RS:1;asf008:47197] procedure.ZKProcedureMemberRpcs(349): Starting procedure member 'asf008.sp2.ygridcore.net,47197,1402818342492' 2014-06-15 07:45:43,620 DEBUG [RS:1;asf008:47197] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-06-15 07:45:43,623 DEBUG [RS:1;asf008:47197] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-06-15 07:45:43,625 DEBUG [SplitLogWorker-asf008.sp2.ygridcore.net,47197,1402818342492-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x376cc3, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:43,625 DEBUG [RS:1;asf008:47197] procedure.RegionServerProcedureManagerHost(54): Procedure online-snapshot is started 2014-06-15 07:45:43,626 DEBUG [RS:1;asf008:47197] procedure.RegionServerProcedureManagerHost(52): Procedure flush-table-proc is starting 2014-06-15 07:45:43,626 DEBUG [RS:1;asf008:47197] flush.RegionServerFlushTableProcedureManager(100): Start region server flush procedure manager asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:43,626 DEBUG [RS:1;asf008:47197] procedure.ZKProcedureMemberRpcs(349): Starting procedure member 'asf008.sp2.ygridcore.net,47197,1402818342492' 2014-06-15 07:45:43,626 DEBUG [RS:1;asf008:47197] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2014-06-15 07:45:43,627 DEBUG [SplitLogWorker-asf008.sp2.ygridcore.net,47197,1402818342492-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x376cc3-0x1469e7d286a000c connected 2014-06-15 07:45:43,628 DEBUG [RS:1;asf008:47197] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:43,629 DEBUG [RS:1;asf008:47197] procedure.RegionServerProcedureManagerHost(54): Procedure flush-table-proc is started 2014-06-15 07:45:44,615 INFO [ActiveMasterManager] zookeeper.MetaRegionTracker(167): Unsetting hbase:meta region location in ZooKeeper 2014-06-15 07:45:44,617 INFO [ActiveMasterManager] zookeeper.RecoverableZooKeeper(166): Node /hbase/meta-region-server already deleted, retry=false 2014-06-15 07:45:44,620 DEBUG [ActiveMasterManager] master.AssignmentManager(2309): No previous transition plan found (or ignoring an existing plan) for hbase:meta,,1.1588230740; generated random plan=hri=hbase:meta,,1.1588230740, src=, dest=asf008.sp2.ygridcore.net,45812,1402818342029; 3 (online=3) available servers, forceNewPlan=false 2014-06-15 07:45:44,621 DEBUG [ActiveMasterManager] zookeeper.ZKAssign(206): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Creating (or updating) unassigned node 1588230740 with OFFLINE state 2014-06-15 07:45:44,630 DEBUG [ActiveMasterManager] master.AssignmentManager(2016): Setting table hbase:meta to ENABLED state. 2014-06-15 07:45:44,630 WARN [ActiveMasterManager] zookeeper.ZKTableStateManager(100): Moving table hbase:meta state from null to ENABLED 2014-06-15 07:45:44,639 INFO [ActiveMasterManager] master.AssignmentManager(2031): Assigning hbase:meta,,1.1588230740 to asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:44,639 INFO [ActiveMasterManager] master.RegionStates(813): Transition {1588230740 state=OFFLINE, ts=1402818344621, server=null} to {1588230740 state=PENDING_OPEN, ts=1402818344639, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:44,640 DEBUG [ActiveMasterManager] master.ServerManager(871): New admin connection to asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:44,661 INFO [ActiveMasterManager] regionserver.RSRpcServices(1230): Open hbase:meta,,1.1588230740 2014-06-15 07:45:44,664 DEBUG [RS_OPEN_META-asf008:45812-0] zookeeper.ZKAssign(805): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Transitioning 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:44,666 INFO [ActiveMasterManager] master.ServerManager(666): AssignmentManager hasn't finished failover cleanup; waiting 2014-06-15 07:45:44,666 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2014-06-15 07:45:44,667 DEBUG [RS_OPEN_META-asf008:45812-0] zookeeper.ZKAssign(880): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Transitioned node 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:44,667 DEBUG [RS_OPEN_META-asf008:45812-0] regionserver.HRegionServer(1400): logdir=hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:44,668 INFO [RS_OPEN_META-asf008:45812-0] wal.FSHLog(447): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, prefix=asf008.sp2.ygridcore.net%2C45812%2C1402818342029, logDir=hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029, oldLogDir=hdfs://localhost:37161/user/jenkins/hbase/oldWALs 2014-06-15 07:45:44,669 DEBUG [AM.ZK.Worker-pool3-t1] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,45812,1402818342029, region=1588230740, current_state={1588230740 state=PENDING_OPEN, ts=1402818344639, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:44,670 INFO [AM.ZK.Worker-pool3-t1] master.RegionStates(813): Transition {1588230740 state=PENDING_OPEN, ts=1402818344639, server=asf008.sp2.ygridcore.net,45812,1402818342029} to {1588230740 state=OPENING, ts=1402818344669, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:44,691 INFO [RS_OPEN_META-asf008:45812-0] wal.FSHLog(888): New WAL /user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029/asf008.sp2.ygridcore.net%2C45812%2C1402818342029.1402818344671.meta 2014-06-15 07:45:44,693 DEBUG [RS_OPEN_META-asf008:45812-0] regionserver.HRegion(4462): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:44,703 DEBUG [RS_OPEN_META-asf008:45812-0] regionserver.HRegion(5559): Registered coprocessor service: region=hbase:meta,,1 service=VisibilityLabelsService 2014-06-15 07:45:44,706 INFO [RS_OPEN_META-asf008:45812-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:44,710 DEBUG [RS_OPEN_META-asf008:45812-0] coprocessor.CoprocessorHost(168): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2014-06-15 07:45:44,712 DEBUG [RS_OPEN_META-asf008:45812-0] regionserver.HRegion(5559): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2014-06-15 07:45:44,713 INFO [RS_OPEN_META-asf008:45812-0] regionserver.RegionCoprocessorHost(209): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2014-06-15 07:45:44,716 DEBUG [RS_OPEN_META-asf008:45812-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table meta 1588230740 2014-06-15 07:45:44,717 DEBUG [RS_OPEN_META-asf008:45812-0] regionserver.HRegion(646): Instantiated hbase:meta,,1.1588230740 2014-06-15 07:45:44,723 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:44,723 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:44,725 DEBUG [StoreOpener-1588230740-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/info 2014-06-15 07:45:44,726 DEBUG [RS_OPEN_META-asf008:45812-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740 2014-06-15 07:45:44,729 INFO [RS_OPEN_META-asf008:45812-0] regionserver.HRegion(747): Onlined 1588230740; next sequenceid=2 2014-06-15 07:45:44,729 DEBUG [RS_OPEN_META-asf008:45812-0] zookeeper.ZKAssign(643): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 1588230740 2014-06-15 07:45:44,731 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1663): Post open deploy tasks for hbase:meta,,1.1588230740 2014-06-15 07:45:44,732 INFO [PostOpenDeployTasks:1588230740] zookeeper.MetaRegionTracker(126): Setting hbase:meta region location in ZooKeeper as asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:44,735 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2014-06-15 07:45:44,735 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2014-06-15 07:45:44,735 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/meta-region-server 2014-06-15 07:45:44,736 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1693): Finished post open deploy task for hbase:meta,,1.1588230740 2014-06-15 07:45:44,737 DEBUG [RS_OPEN_META-asf008:45812-0] zookeeper.ZKAssign(805): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Transitioning 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:44,739 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2014-06-15 07:45:44,739 DEBUG [RS_OPEN_META-asf008:45812-0] zookeeper.ZKAssign(880): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Transitioned node 1588230740 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:44,739 DEBUG [RS_OPEN_META-asf008:45812-0] coordination.ZkOpenRegionCoordination(91): Transitioned 1588230740 to OPENED in zk on asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:44,739 DEBUG [RS_OPEN_META-asf008:45812-0] handler.OpenRegionHandler(167): Opened hbase:meta,,1.1588230740 on asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:44,740 DEBUG [AM.ZK.Worker-pool3-t2] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,45812,1402818342029, region=1588230740, current_state={1588230740 state=OPENING, ts=1402818344669, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:44,740 INFO [AM.ZK.Worker-pool3-t2] master.RegionStates(813): Transition {1588230740 state=OPENING, ts=1402818344669, server=asf008.sp2.ygridcore.net,45812,1402818342029} to {1588230740 state=OPEN, ts=1402818344740, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:44,741 INFO [AM.ZK.Worker-pool3-t2] coordination.ZkOpenRegionCoordination(348): Handling OPENED of 1588230740 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:44,743 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/1588230740 2014-06-15 07:45:44,743 DEBUG [AM.ZK.Worker-pool3-t2] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 1588230740 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:44,744 DEBUG [AM.ZK.Worker-pool3-t3] master.AssignmentManager$4(1293): Znode hbase:meta,,1.1588230740 deleted, state: {1588230740 state=OPEN, ts=1402818344740, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:44,745 INFO [AM.ZK.Worker-pool3-t3] master.RegionStates(359): Onlined 1588230740 on asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:44,745 INFO [ActiveMasterManager] master.HMaster(728): hbase:meta assigned=1, rit=false, location=asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:44,789 INFO [ActiveMasterManager] catalog.MetaMigrationConvertingToPB(166): hbase:meta doesn't have any entries to update. 2014-06-15 07:45:44,789 INFO [ActiveMasterManager] catalog.MetaMigrationConvertingToPB(132): META already up-to date with PB serialization 2014-06-15 07:45:44,795 DEBUG [ActiveMasterManager] zookeeper.ZKAssign(498): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleting any existing unassigned nodes 2014-06-15 07:45:44,796 INFO [ActiveMasterManager] master.AssignmentManager(609): Clean cluster startup. Assigning user regions 2014-06-15 07:45:44,797 INFO [ActiveMasterManager] master.SnapshotOfRegionAssignmentFromMeta(95): Start to scan the hbase:meta for the current region assignment snappshot 2014-06-15 07:45:44,799 INFO [ActiveMasterManager] master.SnapshotOfRegionAssignmentFromMeta(138): Finished to scan the hbase:meta for the current region assignmentsnapshot 2014-06-15 07:45:44,801 INFO [ActiveMasterManager] master.AssignmentManager(475): Joined the cluster in 12ms, failover=false 2014-06-15 07:45:44,808 INFO [ActiveMasterManager] master.TableNamespaceManager(85): Namespace table not found. Creating... 2014-06-15 07:45:44,834 DEBUG [ActiveMasterManager] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/hbase:namespace/write-master:458120000000000 2014-06-15 07:45:44,845 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table hbase:namespace 2014-06-15 07:45:44,875 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:44,877 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741834_1010 size 286 2014-06-15 07:45:44,884 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:44,888 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(4277): creating HRegion hbase:namespace HTD == 'hbase:namespace', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '10', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '8192', IN_MEMORY => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == hbase:namespace 2014-06-15 07:45:44,913 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:44,914 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:44,917 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(646): Instantiated hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:45:44,918 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1116): Closing hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff.: disabling compactions & flushes 2014-06-15 07:45:44,918 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1143): Updates disabled for region hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:45:44,918 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1225): Closed hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:45:45,004 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:45,005 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(2631): Bulk assigning 1 region(s) across 3 server(s), round-robin=true 2014-06-15 07:45:45,007 INFO [asf008.sp2.ygridcore.net,45812,1402818342029-GeneralBulkAssigner-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:45,008 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.GeneralBulkAssigner(177): Timeout-on-RIT=151000 2014-06-15 07:45:45,009 DEBUG [asf008.sp2.ygridcore.net,45812,1402818342029-GeneralBulkAssigner-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node f474159b9b2c9ce6028f93b01d8c97ff with OFFLINE state 2014-06-15 07:45:45,011 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:45,014 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={f474159b9b2c9ce6028f93b01d8c97ff state=OFFLINE, ts=1402818345005, server=null}, server=asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:45,015 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={f474159b9b2c9ce6028f93b01d8c97ff state=OFFLINE, ts=1402818345005, server=null}, server=asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:45,020 DEBUG [asf008.sp2.ygridcore.net,45812,1402818342029-GeneralBulkAssigner-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,45812,1402818342029 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:45,020 INFO [asf008.sp2.ygridcore.net,45812,1402818342029-GeneralBulkAssigner-0] master.RegionStates(813): Transition {f474159b9b2c9ce6028f93b01d8c97ff state=OFFLINE, ts=1402818345009, server=null} to {f474159b9b2c9ce6028f93b01d8c97ff state=PENDING_OPEN, ts=1402818345020, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:45,021 INFO [asf008.sp2.ygridcore.net,45812,1402818342029-GeneralBulkAssigner-0] regionserver.RSRpcServices(1230): Open hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:45:45,030 DEBUG [asf008.sp2.ygridcore.net,45812,1402818342029-GeneralBulkAssigner-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:45,030 DEBUG [RS_OPEN_REGION-asf008:45812-0] zookeeper.ZKAssign(805): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Transitioning f474159b9b2c9ce6028f93b01d8c97ff from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:45,031 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.GeneralBulkAssigner(153): bulk assigning total 1 regions to 3 servers, took 23ms, with 1 regions still in transition 2014-06-15 07:45:45,031 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(2638): Bulk assigning done 2014-06-15 07:45:45,031 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table hbase:namespace state from ENABLING to ENABLED 2014-06-15 07:45:45,033 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f474159b9b2c9ce6028f93b01d8c97ff 2014-06-15 07:45:45,034 DEBUG [RS_OPEN_REGION-asf008:45812-0] zookeeper.ZKAssign(880): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Transitioned node f474159b9b2c9ce6028f93b01d8c97ff from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:45,036 DEBUG [RS_OPEN_REGION-asf008:45812-0] regionserver.HRegion(4462): Opening region: {ENCODED => f474159b9b2c9ce6028f93b01d8c97ff, NAME => 'hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:45,036 DEBUG [AM.ZK.Worker-pool3-t5] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,45812,1402818342029, region=f474159b9b2c9ce6028f93b01d8c97ff, current_state={f474159b9b2c9ce6028f93b01d8c97ff state=PENDING_OPEN, ts=1402818345020, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:45,036 INFO [AM.ZK.Worker-pool3-t5] master.RegionStates(813): Transition {f474159b9b2c9ce6028f93b01d8c97ff state=PENDING_OPEN, ts=1402818345020, server=asf008.sp2.ygridcore.net,45812,1402818342029} to {f474159b9b2c9ce6028f93b01d8c97ff state=OPENING, ts=1402818345036, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:45,037 DEBUG [RS_OPEN_REGION-asf008:45812-0] regionserver.HRegion(5559): Registered coprocessor service: region=hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. service=VisibilityLabelsService 2014-06-15 07:45:45,037 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/hbase:namespace/write-master:458120000000000 2014-06-15 07:45:45,037 INFO [RS_OPEN_REGION-asf008:45812-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:45,038 DEBUG [RS_OPEN_REGION-asf008:45812-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table namespace f474159b9b2c9ce6028f93b01d8c97ff 2014-06-15 07:45:45,038 DEBUG [RS_OPEN_REGION-asf008:45812-0] regionserver.HRegion(646): Instantiated hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:45:45,047 INFO [StoreOpener-f474159b9b2c9ce6028f93b01d8c97ff-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:45,047 INFO [StoreOpener-f474159b9b2c9ce6028f93b01d8c97ff-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:45,050 DEBUG [StoreOpener-f474159b9b2c9ce6028f93b01d8c97ff-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/hbase/namespace/f474159b9b2c9ce6028f93b01d8c97ff/info 2014-06-15 07:45:45,051 DEBUG [RS_OPEN_REGION-asf008:45812-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/hbase/namespace/f474159b9b2c9ce6028f93b01d8c97ff 2014-06-15 07:45:45,054 INFO [RS_OPEN_REGION-asf008:45812-0] regionserver.HRegion(747): Onlined f474159b9b2c9ce6028f93b01d8c97ff; next sequenceid=2 2014-06-15 07:45:45,054 DEBUG [RS_OPEN_REGION-asf008:45812-0] zookeeper.ZKAssign(643): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node f474159b9b2c9ce6028f93b01d8c97ff 2014-06-15 07:45:45,055 INFO [PostOpenDeployTasks:f474159b9b2c9ce6028f93b01d8c97ff] regionserver.HRegionServer(1663): Post open deploy tasks for hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:45:45,064 INFO [PostOpenDeployTasks:f474159b9b2c9ce6028f93b01d8c97ff] catalog.MetaEditor(464): Updated row hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. with server=asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:45,064 DEBUG [PostOpenDeployTasks:f474159b9b2c9ce6028f93b01d8c97ff] regionserver.HRegionServer(1693): Finished post open deploy task for hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:45:45,064 DEBUG [RS_OPEN_REGION-asf008:45812-0] zookeeper.ZKAssign(805): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Transitioning f474159b9b2c9ce6028f93b01d8c97ff from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:45,068 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f474159b9b2c9ce6028f93b01d8c97ff 2014-06-15 07:45:45,068 DEBUG [RS_OPEN_REGION-asf008:45812-0] zookeeper.ZKAssign(880): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Transitioned node f474159b9b2c9ce6028f93b01d8c97ff from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:45,069 DEBUG [RS_OPEN_REGION-asf008:45812-0] coordination.ZkOpenRegionCoordination(91): Transitioned f474159b9b2c9ce6028f93b01d8c97ff to OPENED in zk on asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:45,069 DEBUG [RS_OPEN_REGION-asf008:45812-0] handler.OpenRegionHandler(167): Opened hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. on asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:45,069 DEBUG [AM.ZK.Worker-pool3-t6] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,45812,1402818342029, region=f474159b9b2c9ce6028f93b01d8c97ff, current_state={f474159b9b2c9ce6028f93b01d8c97ff state=OPENING, ts=1402818345036, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:45,070 INFO [AM.ZK.Worker-pool3-t6] master.RegionStates(813): Transition {f474159b9b2c9ce6028f93b01d8c97ff state=OPENING, ts=1402818345036, server=asf008.sp2.ygridcore.net,45812,1402818342029} to {f474159b9b2c9ce6028f93b01d8c97ff state=OPEN, ts=1402818345070, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:45,070 DEBUG [AM.ZK.Worker-pool3-t6] coordination.ZkOpenRegionCoordination(350): Handling OPENED of f474159b9b2c9ce6028f93b01d8c97ff from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:45,080 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/f474159b9b2c9ce6028f93b01d8c97ff 2014-06-15 07:45:45,080 DEBUG [AM.ZK.Worker-pool3-t6] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node f474159b9b2c9ce6028f93b01d8c97ff in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:45,080 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:45,082 DEBUG [AM.ZK.Worker-pool3-t8] master.AssignmentManager$4(1293): Znode hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. deleted, state: {f474159b9b2c9ce6028f93b01d8c97ff state=OPEN, ts=1402818345070, server=asf008.sp2.ygridcore.net,45812,1402818342029} 2014-06-15 07:45:45,082 INFO [AM.ZK.Worker-pool3-t8] master.RegionStates(359): Onlined f474159b9b2c9ce6028f93b01d8c97ff on asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:45,150 DEBUG [ActiveMasterManager] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2014-06-15 07:45:45,152 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2014-06-15 07:45:45,197 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2014-06-15 07:45:45,200 DEBUG [pool-1-thread-1-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node default with data: \x0A\x07default 2014-06-15 07:45:45,208 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2014-06-15 07:45:45,213 DEBUG [pool-1-thread-1-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node default with data: \x0A\x07default 2014-06-15 07:45:45,213 DEBUG [pool-1-thread-1-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node hbase with data: \x0A\x05hbase 2014-06-15 07:45:45,219 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper(508): Node /hbase/namespace/default already exists 2014-06-15 07:45:45,220 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2014-06-15 07:45:45,222 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper(508): Node /hbase/namespace/hbase already exists 2014-06-15 07:45:45,224 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2014-06-15 07:45:45,224 INFO [ActiveMasterManager] master.HMaster(612): Master has completed initialization 2014-06-15 07:45:45,233 INFO [ActiveMasterManager] master.HMaster(1124): Client=null/null create 'hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy', 'hbase.regionserver.disallow.writes.when.recovering' => '\xFF'}}, {NAME => 'f', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'false'} 2014-06-15 07:45:45,242 DEBUG [ActiveMasterManager] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/hbase:labels/write-master:458120000000000 2014-06-15 07:45:45,251 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table hbase:labels 2014-06-15 07:45:45,275 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:45,277 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:45,289 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/hbase/labels/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:45,292 INFO [RegionOpenAndInitThread-hbase:labels-1] regionserver.HRegion(4277): creating HRegion hbase:labels HTD == 'hbase:labels', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy', 'hbase.regionserver.disallow.writes.when.recovering' => '\xFF'}}, {NAME => 'f', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => 'FOREVER', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'false'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == hbase:labels 2014-06-15 07:45:45,297 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0xeb3f66 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:45,310 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0xeb3f66, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:45,313 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0xeb3f66-0x1469e7d286a000d connected 2014-06-15 07:45:45,319 INFO [pool-1-thread-1] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a000d 2014-06-15 07:45:45,372 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:45,374 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:45,377 DEBUG [RegionOpenAndInitThread-hbase:labels-1] regionserver.HRegion(646): Instantiated hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:45:45,380 DEBUG [RegionOpenAndInitThread-hbase:labels-1] regionserver.HRegion(1116): Closing hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763.: disabling compactions & flushes 2014-06-15 07:45:45,380 DEBUG [RegionOpenAndInitThread-hbase:labels-1] regionserver.HRegion(1143): Updates disabled for region hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:45:45,380 INFO [RegionOpenAndInitThread-hbase:labels-1] regionserver.HRegion(1225): Closed hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:45:45,388 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:45,388 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,388 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 186bffbec8527bc95ede4c00649e8763 with OFFLINE state 2014-06-15 07:45:45,407 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:45,408 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={186bffbec8527bc95ede4c00649e8763 state=OFFLINE, ts=1402818345388, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,409 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={186bffbec8527bc95ede4c00649e8763 state=OFFLINE, ts=1402818345388, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,409 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:45,409 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {186bffbec8527bc95ede4c00649e8763 state=OFFLINE, ts=1402818345388, server=null} to {186bffbec8527bc95ede4c00649e8763 state=PENDING_OPEN, ts=1402818345409, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:45,409 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.ServerManager(871): New admin connection to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,413 INFO [Priority.RpcServer.handler=0,port=47197] regionserver.RSRpcServices(1230): Open hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:45:45,429 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 186bffbec8527bc95ede4c00649e8763 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:45,431 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,431 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table hbase:labels state from ENABLING to ENABLED 2014-06-15 07:45:45,438 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/186bffbec8527bc95ede4c00649e8763 2014-06-15 07:45:45,438 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 186bffbec8527bc95ede4c00649e8763 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:45,439 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(4462): Opening region: {ENCODED => 186bffbec8527bc95ede4c00649e8763, NAME => 'hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:45,440 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(5559): Registered coprocessor service: region=hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. service=VisibilityLabelsService 2014-06-15 07:45:45,440 INFO [RS_OPEN_REGION-asf008:47197-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:45,440 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table labels 186bffbec8527bc95ede4c00649e8763 2014-06-15 07:45:45,441 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(646): Instantiated hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:45:45,447 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/hbase:labels/write-master:458120000000000 2014-06-15 07:45:45,448 DEBUG [AM.ZK.Worker-pool3-t10] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=186bffbec8527bc95ede4c00649e8763, current_state={186bffbec8527bc95ede4c00649e8763 state=PENDING_OPEN, ts=1402818345409, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:45,448 INFO [AM.ZK.Worker-pool3-t10] master.RegionStates(813): Transition {186bffbec8527bc95ede4c00649e8763 state=PENDING_OPEN, ts=1402818345409, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {186bffbec8527bc95ede4c00649e8763 state=OPENING, ts=1402818345448, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:45,454 INFO [StoreOpener-186bffbec8527bc95ede4c00649e8763-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:45,455 INFO [StoreOpener-186bffbec8527bc95ede4c00649e8763-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:45,458 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:45,458 DEBUG [StoreOpener-186bffbec8527bc95ede4c00649e8763-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/hbase/labels/186bffbec8527bc95ede4c00649e8763/f 2014-06-15 07:45:45,461 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:45,463 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/hbase/labels/186bffbec8527bc95ede4c00649e8763 2014-06-15 07:45:45,464 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x19cad9d-0x1469e7d286a000e connected 2014-06-15 07:45:45,465 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(907): Minicluster is up 2014-06-15 07:45:45,466 INFO [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(747): Onlined 186bffbec8527bc95ede4c00649e8763; next sequenceid=2 2014-06-15 07:45:45,508 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/visibility/labels 2014-06-15 07:45:45,509 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/visibility/labels 2014-06-15 07:45:45,510 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2014-06-15 07:45:45,523 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:45,526 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/visibility/user_auths 2014-06-15 07:45:45,530 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/labels already exists 2014-06-15 07:45:45,532 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2014-06-15 07:45:45,535 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:45,538 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:45,538 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 186bffbec8527bc95ede4c00649e8763 2014-06-15 07:45:45,541 INFO [PostOpenDeployTasks:186bffbec8527bc95ede4c00649e8763] regionserver.HRegionServer(1663): Post open deploy tasks for hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:45:45,552 INFO [PostOpenDeployTasks:186bffbec8527bc95ede4c00649e8763] catalog.MetaEditor(464): Updated row hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,553 DEBUG [PostOpenDeployTasks:186bffbec8527bc95ede4c00649e8763] regionserver.HRegionServer(1693): Finished post open deploy task for hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:45:45,553 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 186bffbec8527bc95ede4c00649e8763 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:45,557 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 186bffbec8527bc95ede4c00649e8763 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:45,557 DEBUG [RS_OPEN_REGION-asf008:47197-0] coordination.ZkOpenRegionCoordination(91): Transitioned 186bffbec8527bc95ede4c00649e8763 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,558 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/186bffbec8527bc95ede4c00649e8763 2014-06-15 07:45:45,558 DEBUG [RS_OPEN_REGION-asf008:47197-0] handler.OpenRegionHandler(167): Opened hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,559 DEBUG [AM.ZK.Worker-pool3-t11] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=186bffbec8527bc95ede4c00649e8763, current_state={186bffbec8527bc95ede4c00649e8763 state=OPENING, ts=1402818345448, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:45,559 INFO [AM.ZK.Worker-pool3-t11] master.RegionStates(813): Transition {186bffbec8527bc95ede4c00649e8763 state=OPENING, ts=1402818345448, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {186bffbec8527bc95ede4c00649e8763 state=OPEN, ts=1402818345559, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:45,560 DEBUG [AM.ZK.Worker-pool3-t11] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 186bffbec8527bc95ede4c00649e8763 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:45,563 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/186bffbec8527bc95ede4c00649e8763 2014-06-15 07:45:45,563 DEBUG [AM.ZK.Worker-pool3-t11] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 186bffbec8527bc95ede4c00649e8763 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:45,563 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:45,564 DEBUG [AM.ZK.Worker-pool3-t12] master.AssignmentManager$4(1293): Znode hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. deleted, state: {186bffbec8527bc95ede4c00649e8763 state=OPEN, ts=1402818345559, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:45,564 INFO [AM.ZK.Worker-pool3-t12] master.RegionStates(359): Onlined 186bffbec8527bc95ede4c00649e8763 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:45,707 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:45,708 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:45,711 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:45,711 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:45,712 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a000f connected 2014-06-15 07:45:45,718 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a000f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:45,764 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:45,769 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:45,771 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:45,771 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:45,772 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0010 connected 2014-06-15 07:45:45,782 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0010, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:45,827 INFO [pool-1-thread-1] tool.Canary$StdOutSink(95): read from region hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. column family f in 10ms 2014-06-15 07:45:45,834 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=hconnection-0x18430a5 connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:45,840 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x18430a5, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:45,841 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): hconnection-0x18430a5-0x1469e7d286a0011 connected 2014-06-15 07:45:45,874 DEBUG [RpcServer.handler=3,port=47197] visibility.VisibilityController(1244): Adding the label SECRET 2014-06-15 07:45:45,874 DEBUG [RpcServer.handler=3,port=47197] visibility.VisibilityController(1244): Adding the label TOPSECRET 2014-06-15 07:45:45,874 DEBUG [RpcServer.handler=3,port=47197] visibility.VisibilityController(1244): Adding the label CONFIDENTIAL 2014-06-15 07:45:45,874 DEBUG [RpcServer.handler=3,port=47197] visibility.VisibilityController(1244): Adding the label PUBLIC 2014-06-15 07:45:45,874 DEBUG [RpcServer.handler=3,port=47197] visibility.VisibilityController(1244): Adding the label PRIVATE 2014-06-15 07:45:45,934 DEBUG [RpcServer.handler=3,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/labels already exists 2014-06-15 07:45:45,935 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/labels 2014-06-15 07:45:45,978 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDiffDeleteTypesForTheSameCellUsingMultipleVersions Thread=346, OpenFileDescriptor=502, MaxFileDescriptor=60000, SystemLoadAverage=652, ProcessCount=176, AvailableMemoryMB=3260, ConnectionCount=8 2014-06-15 07:45:46,005 DEBUG [RpcServer.handler=4,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:46,006 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:46,016 INFO [RpcServer.handler=3,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:46,026 DEBUG [RpcServer.handler=3,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/write-master:458120000000000 2014-06-15 07:45:46,032 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,057 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:46,059 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741838_1014 size 334 2014-06-15 07:45:46,068 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:46,070 INFO [RegionOpenAndInitThread-testDiffDeleteTypesForTheSameCellUsingMultipleVersions-1] regionserver.HRegion(4277): creating HRegion testDiffDeleteTypesForTheSameCellUsingMultipleVersions HTD == 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,098 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:46,100 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:46,104 DEBUG [RegionOpenAndInitThread-testDiffDeleteTypesForTheSameCellUsingMultipleVersions-1] regionserver.HRegion(646): Instantiated testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,104 DEBUG [RegionOpenAndInitThread-testDiffDeleteTypesForTheSameCellUsingMultipleVersions-1] regionserver.HRegion(1116): Closing testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b.: disabling compactions & flushes 2014-06-15 07:45:46,104 DEBUG [RegionOpenAndInitThread-testDiffDeleteTypesForTheSameCellUsingMultipleVersions-1] regionserver.HRegion(1143): Updates disabled for region testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,105 INFO [RegionOpenAndInitThread-testDiffDeleteTypesForTheSameCellUsingMultipleVersions-1] regionserver.HRegion(1225): Closed testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,113 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:46,114 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,114 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 08be65be204e2a7eab339d50d61bdb2b with OFFLINE state 2014-06-15 07:45:46,116 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:46,117 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={08be65be204e2a7eab339d50d61bdb2b state=OFFLINE, ts=1402818346114, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,117 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={08be65be204e2a7eab339d50d61bdb2b state=OFFLINE, ts=1402818346114, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,120 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:46,120 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {08be65be204e2a7eab339d50d61bdb2b state=OFFLINE, ts=1402818346114, server=null} to {08be65be204e2a7eab339d50d61bdb2b state=PENDING_OPEN, ts=1402818346120, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:46,120 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.ServerManager(871): New admin connection to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,122 INFO [Priority.RpcServer.handler=0,port=57332] regionserver.RSRpcServices(1230): Open testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,129 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 08be65be204e2a7eab339d50d61bdb2b from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:46,130 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,130 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDiffDeleteTypesForTheSameCellUsingMultipleVersions state from ENABLING to ENABLED 2014-06-15 07:45:46,133 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/08be65be204e2a7eab339d50d61bdb2b 2014-06-15 07:45:46,134 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 08be65be204e2a7eab339d50d61bdb2b from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:46,134 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(4462): Opening region: {ENCODED => 08be65be204e2a7eab339d50d61bdb2b, NAME => 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:46,135 DEBUG [AM.ZK.Worker-pool3-t15] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=08be65be204e2a7eab339d50d61bdb2b, current_state={08be65be204e2a7eab339d50d61bdb2b state=PENDING_OPEN, ts=1402818346120, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:46,135 INFO [AM.ZK.Worker-pool3-t15] master.RegionStates(813): Transition {08be65be204e2a7eab339d50d61bdb2b state=PENDING_OPEN, ts=1402818346120, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {08be65be204e2a7eab339d50d61bdb2b state=OPENING, ts=1402818346135, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:46,135 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(5559): Registered coprocessor service: region=testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. service=VisibilityLabelsService 2014-06-15 07:45:46,135 INFO [RS_OPEN_REGION-asf008:57332-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:46,136 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDiffDeleteTypesForTheSameCellUsingMultipleVersions 08be65be204e2a7eab339d50d61bdb2b 2014-06-15 07:45:46,136 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(646): Instantiated testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,137 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/write-master:458120000000000 2014-06-15 07:45:46,145 INFO [StoreOpener-08be65be204e2a7eab339d50d61bdb2b-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:46,146 INFO [StoreOpener-08be65be204e2a7eab339d50d61bdb2b-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:46,148 DEBUG [StoreOpener-08be65be204e2a7eab339d50d61bdb2b-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/info 2014-06-15 07:45:46,150 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b 2014-06-15 07:45:46,154 INFO [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(747): Onlined 08be65be204e2a7eab339d50d61bdb2b; next sequenceid=2 2014-06-15 07:45:46,154 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 08be65be204e2a7eab339d50d61bdb2b 2014-06-15 07:45:46,156 INFO [PostOpenDeployTasks:08be65be204e2a7eab339d50d61bdb2b] regionserver.HRegionServer(1663): Post open deploy tasks for testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,169 INFO [PostOpenDeployTasks:08be65be204e2a7eab339d50d61bdb2b] catalog.MetaEditor(464): Updated row testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,169 DEBUG [PostOpenDeployTasks:08be65be204e2a7eab339d50d61bdb2b] regionserver.HRegionServer(1693): Finished post open deploy task for testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,170 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 08be65be204e2a7eab339d50d61bdb2b from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:46,173 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/08be65be204e2a7eab339d50d61bdb2b 2014-06-15 07:45:46,173 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 08be65be204e2a7eab339d50d61bdb2b from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:46,173 DEBUG [RS_OPEN_REGION-asf008:57332-0] coordination.ZkOpenRegionCoordination(91): Transitioned 08be65be204e2a7eab339d50d61bdb2b to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,173 DEBUG [RS_OPEN_REGION-asf008:57332-0] handler.OpenRegionHandler(167): Opened testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,175 DEBUG [AM.ZK.Worker-pool3-t16] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=08be65be204e2a7eab339d50d61bdb2b, current_state={08be65be204e2a7eab339d50d61bdb2b state=OPENING, ts=1402818346135, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:46,175 INFO [AM.ZK.Worker-pool3-t16] master.RegionStates(813): Transition {08be65be204e2a7eab339d50d61bdb2b state=OPENING, ts=1402818346135, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {08be65be204e2a7eab339d50d61bdb2b state=OPEN, ts=1402818346175, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:46,175 DEBUG [AM.ZK.Worker-pool3-t16] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 08be65be204e2a7eab339d50d61bdb2b from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:46,178 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/08be65be204e2a7eab339d50d61bdb2b 2014-06-15 07:45:46,179 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:46,179 DEBUG [AM.ZK.Worker-pool3-t16] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 08be65be204e2a7eab339d50d61bdb2b in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:46,180 DEBUG [AM.ZK.Worker-pool3-t18] master.AssignmentManager$4(1293): Znode testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. deleted, state: {08be65be204e2a7eab339d50d61bdb2b state=OPEN, ts=1402818346175, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:46,180 INFO [AM.ZK.Worker-pool3-t18] master.RegionStates(359): Onlined 08be65be204e2a7eab339d50d61bdb2b on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,351 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:46,351 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:46,356 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:46,357 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:46,357 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0012 connected 2014-06-15 07:45:46,364 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0012, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:46,413 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:46,413 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:46,419 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:46,419 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:46,420 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0013 connected 2014-06-15 07:45:46,434 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:46,435 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:46,436 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:46,437 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:46,438 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0014 connected 2014-06-15 07:45:46,446 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0014, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:46,462 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:46,472 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' 2014-06-15 07:45:46,472 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:46,473 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' starting 'acquire' 2014-06-15 07:45:46,473 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:45:46,474 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,474 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,475 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:46,476 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,476 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:46,475 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:46,475 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:46,476 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:46,476 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,476 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:46,476 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:46,476 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:46,476 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:46,477 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:46,477 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,477 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,478 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,478 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,478 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,478 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:46,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:46,479 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:46,480 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,480 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,480 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,482 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,482 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,484 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,484 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:45:46,484 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:46,487 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:46,487 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' locally acquired 2014-06-15 07:45:46,487 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDiffDeleteTypesForTheSameCellUsingMultipleVersions) in zk 2014-06-15 07:45:46,485 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:45:46,487 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:46,488 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:45:46,488 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:46,488 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:46,489 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:46,489 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' locally acquired 2014-06-15 07:45:46,489 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDiffDeleteTypesForTheSameCellUsingMultipleVersions) in zk 2014-06-15 07:45:46,489 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:46,489 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool11-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,489 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:46,490 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool11-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. started... 2014-06-15 07:45:46,490 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool11-thread-1] regionserver.HRegion(1696): Started memstore flush for testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b., current region memstore size 712 B 2014-06-15 07:45:46,490 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,491 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,491 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,492 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:46,492 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,492 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:46,553 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:46,554 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:46,557 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool11-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/.tmp/de2f34c16e8c496ca24df590bdf97de2 2014-06-15 07:45:46,620 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool11-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/.tmp/de2f34c16e8c496ca24df590bdf97de2 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/info/de2f34c16e8c496ca24df590bdf97de2 2014-06-15 07:45:46,640 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool11-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/info/de2f34c16e8c496ca24df590bdf97de2, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:45:46,641 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool11-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. in 151ms, sequenceid=13, compaction requested=false 2014-06-15 07:45:46,643 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool11-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:45:46,643 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:46,644 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:46,644 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,644 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' locally acquired 2014-06-15 07:45:46,644 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDiffDeleteTypesForTheSameCellUsingMultipleVersions) in zk 2014-06-15 07:45:46,646 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,646 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,647 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,647 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,647 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,647 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,647 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:46,647 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:46,647 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:46,648 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:46,649 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,650 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:46,650 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,651 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:46,652 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:46,653 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:46,653 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' on coordinator 2014-06-15 07:45:46,654 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@a4b9da[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:46,654 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:45:46,654 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,657 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,657 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,657 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,657 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,657 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,658 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,658 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:46,657 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,658 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' locally completed 2014-06-15 07:45:46,658 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:46,658 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,658 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,659 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:46,659 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:46,658 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' locally completed 2014-06-15 07:45:46,658 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:46,659 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:46,658 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,659 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,659 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:46,659 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' locally completed 2014-06-15 07:45:46,659 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:46,660 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:46,660 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,689 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' has notified controller of completion 2014-06-15 07:45:46,689 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:46,689 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' completed. 2014-06-15 07:45:46,689 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' has notified controller of completion 2014-06-15 07:45:46,690 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:46,690 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' completed. 2014-06-15 07:45:46,691 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' has notified controller of completion 2014-06-15 07:45:46,691 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:46,691 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:46,691 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' completed. 2014-06-15 07:45:46,692 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,693 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:46,693 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:46,694 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:46,695 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,695 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:46,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:46,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,697 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:46,697 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,697 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:46,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:46,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:46,699 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,699 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:46,700 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,700 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:46,701 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:46,701 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:46,702 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,702 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:46,703 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:46,703 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:46,704 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:46,705 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDiffDeleteTypesForTheSameCellUsingMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:45:46,705 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' execution completed 2014-06-15 07:45:46,705 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:46,705 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:46,705 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDiffDeleteTypesForTheSameCellUsingMultipleVersions 2014-06-15 07:45:46,705 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDiffDeleteTypesForTheSameCellUsingMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:46,718 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:46,718 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:46,718 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:46,718 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:46,718 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:46,718 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:46,718 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:46,718 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:46,718 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:46,726 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:46,726 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDiffDeleteTypesForTheSameCellUsingMultipleVersions' 2014-06-15 07:45:46,727 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:46,729 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDiffDeleteTypesForTheSameCellUsingMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:46,729 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:46,829 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:46,836 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:46,838 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0013, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:46,939 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDiffDeleteTypesForTheSameCellUsingMultipleVersions Thread=361 (was 346) Potentially hanging thread: AM.ZK.Worker-pool3-t15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: AM.ZK.Worker-pool3-t18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: IPC Client (23708568) connection to asf008.sp2.ygridcore.net/67.195.138.23:57332 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:728) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:767) Potentially hanging thread: member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:422) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:857) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: IPC Client (23708568) connection to asf008.sp2.ygridcore.net/67.195.138.23:57332 from admin java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:728) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:767) Potentially hanging thread: AM.ZK.Worker-pool3-t14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: AM.ZK.Worker-pool3-t17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: RS_OPEN_REGION-asf008:57332-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1952120439_8 at /127.0.0.1:35163 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:422) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:857) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: AM.ZK.Worker-pool3-t16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:422) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:857) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:39245 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: IPC Client (23708568) connection to asf008.sp2.ygridcore.net/67.195.138.23:57332 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:728) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:767) Potentially hanging thread: (asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:422) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:857) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=519 (was 502) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=652 (was 652), ProcessCount=176 (was 176), AvailableMemoryMB=3193 (was 3260), ConnectionCount=8 (was 8) 2014-06-15 07:45:46,961 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityExpressionWithNotEqualORCondition Thread=362, OpenFileDescriptor=517, MaxFileDescriptor=60000, SystemLoadAverage=652, ProcessCount=176, AvailableMemoryMB=3193, ConnectionCount=8 2014-06-15 07:45:47,035 DEBUG [RpcServer.handler=1,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:47,039 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:47,044 INFO [RpcServer.handler=2,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testVisibilityExpressionWithNotEqualORCondition', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:47,051 DEBUG [RpcServer.handler=2,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testVisibilityExpressionWithNotEqualORCondition/write-master:458120000000000 2014-06-15 07:45:47,059 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,078 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:47,079 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:47,092 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testVisibilityExpressionWithNotEqualORCondition/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:47,095 INFO [RegionOpenAndInitThread-testVisibilityExpressionWithNotEqualORCondition-1] regionserver.HRegion(4277): creating HRegion testVisibilityExpressionWithNotEqualORCondition HTD == 'testVisibilityExpressionWithNotEqualORCondition', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,117 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:47,121 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:47,126 DEBUG [RegionOpenAndInitThread-testVisibilityExpressionWithNotEqualORCondition-1] regionserver.HRegion(646): Instantiated testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,127 DEBUG [RegionOpenAndInitThread-testVisibilityExpressionWithNotEqualORCondition-1] regionserver.HRegion(1116): Closing testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17.: disabling compactions & flushes 2014-06-15 07:45:47,127 DEBUG [RegionOpenAndInitThread-testVisibilityExpressionWithNotEqualORCondition-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,127 INFO [RegionOpenAndInitThread-testVisibilityExpressionWithNotEqualORCondition-1] regionserver.HRegion(1225): Closed testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,135 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:47,136 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,136 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 3b34b9f16dc3a089c57939b3fb3d7a17 with OFFLINE state 2014-06-15 07:45:47,139 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:47,139 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={3b34b9f16dc3a089c57939b3fb3d7a17 state=OFFLINE, ts=1402818347136, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,140 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={3b34b9f16dc3a089c57939b3fb3d7a17 state=OFFLINE, ts=1402818347136, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,142 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:47,142 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {3b34b9f16dc3a089c57939b3fb3d7a17 state=OFFLINE, ts=1402818347136, server=null} to {3b34b9f16dc3a089c57939b3fb3d7a17 state=PENDING_OPEN, ts=1402818347142, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:47,143 INFO [Priority.RpcServer.handler=1,port=57332] regionserver.RSRpcServices(1230): Open testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,151 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,151 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 3b34b9f16dc3a089c57939b3fb3d7a17 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:47,151 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testVisibilityExpressionWithNotEqualORCondition state from ENABLING to ENABLED 2014-06-15 07:45:47,155 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3b34b9f16dc3a089c57939b3fb3d7a17 2014-06-15 07:45:47,155 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 3b34b9f16dc3a089c57939b3fb3d7a17 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:47,156 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(4462): Opening region: {ENCODED => 3b34b9f16dc3a089c57939b3fb3d7a17, NAME => 'testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:47,157 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testVisibilityExpressionWithNotEqualORCondition/write-master:458120000000000 2014-06-15 07:45:47,157 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(5559): Registered coprocessor service: region=testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. service=VisibilityLabelsService 2014-06-15 07:45:47,157 DEBUG [AM.ZK.Worker-pool3-t20] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=3b34b9f16dc3a089c57939b3fb3d7a17, current_state={3b34b9f16dc3a089c57939b3fb3d7a17 state=PENDING_OPEN, ts=1402818347142, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:47,157 INFO [RS_OPEN_REGION-asf008:57332-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:47,157 INFO [AM.ZK.Worker-pool3-t20] master.RegionStates(813): Transition {3b34b9f16dc3a089c57939b3fb3d7a17 state=PENDING_OPEN, ts=1402818347142, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {3b34b9f16dc3a089c57939b3fb3d7a17 state=OPENING, ts=1402818347157, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:47,158 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testVisibilityExpressionWithNotEqualORCondition 3b34b9f16dc3a089c57939b3fb3d7a17 2014-06-15 07:45:47,158 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(646): Instantiated testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,166 INFO [StoreOpener-3b34b9f16dc3a089c57939b3fb3d7a17-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:47,167 INFO [StoreOpener-3b34b9f16dc3a089c57939b3fb3d7a17-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:47,169 DEBUG [StoreOpener-3b34b9f16dc3a089c57939b3fb3d7a17-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/info 2014-06-15 07:45:47,171 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17 2014-06-15 07:45:47,173 INFO [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(747): Onlined 3b34b9f16dc3a089c57939b3fb3d7a17; next sequenceid=2 2014-06-15 07:45:47,173 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 3b34b9f16dc3a089c57939b3fb3d7a17 2014-06-15 07:45:47,175 INFO [PostOpenDeployTasks:3b34b9f16dc3a089c57939b3fb3d7a17] regionserver.HRegionServer(1663): Post open deploy tasks for testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,213 INFO [PostOpenDeployTasks:3b34b9f16dc3a089c57939b3fb3d7a17] catalog.MetaEditor(464): Updated row testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,213 DEBUG [PostOpenDeployTasks:3b34b9f16dc3a089c57939b3fb3d7a17] regionserver.HRegionServer(1693): Finished post open deploy task for testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,214 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 3b34b9f16dc3a089c57939b3fb3d7a17 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:47,225 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3b34b9f16dc3a089c57939b3fb3d7a17 2014-06-15 07:45:47,225 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 3b34b9f16dc3a089c57939b3fb3d7a17 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:47,225 DEBUG [RS_OPEN_REGION-asf008:57332-1] coordination.ZkOpenRegionCoordination(91): Transitioned 3b34b9f16dc3a089c57939b3fb3d7a17 to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,225 DEBUG [RS_OPEN_REGION-asf008:57332-1] handler.OpenRegionHandler(167): Opened testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,226 DEBUG [AM.ZK.Worker-pool3-t1] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=3b34b9f16dc3a089c57939b3fb3d7a17, current_state={3b34b9f16dc3a089c57939b3fb3d7a17 state=OPENING, ts=1402818347157, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:47,226 INFO [AM.ZK.Worker-pool3-t1] master.RegionStates(813): Transition {3b34b9f16dc3a089c57939b3fb3d7a17 state=OPENING, ts=1402818347157, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {3b34b9f16dc3a089c57939b3fb3d7a17 state=OPEN, ts=1402818347226, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:47,226 DEBUG [AM.ZK.Worker-pool3-t1] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 3b34b9f16dc3a089c57939b3fb3d7a17 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:47,230 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/3b34b9f16dc3a089c57939b3fb3d7a17 2014-06-15 07:45:47,230 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:47,230 DEBUG [AM.ZK.Worker-pool3-t1] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 3b34b9f16dc3a089c57939b3fb3d7a17 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:47,230 DEBUG [AM.ZK.Worker-pool3-t1] master.AssignmentManager$4(1293): Znode testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. deleted, state: {3b34b9f16dc3a089c57939b3fb3d7a17 state=OPEN, ts=1402818347226, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:47,230 INFO [AM.ZK.Worker-pool3-t1] master.RegionStates(359): Onlined 3b34b9f16dc3a089c57939b3fb3d7a17 on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,376 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:47,376 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,379 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:47,379 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:47,380 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0015 connected 2014-06-15 07:45:47,384 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0015, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,400 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:47,400 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,403 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:47,405 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:47,405 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0016 connected 2014-06-15 07:45:47,455 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:47,456 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:47,456 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,457 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0017 connected 2014-06-15 07:45:47,458 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0017, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:47,465 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0017, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,468 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:47,484 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityExpressionWithNotEqualORCondition' 2014-06-15 07:45:47,484 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:47,484 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'acquire' 2014-06-15 07:45:47,484 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityExpressionWithNotEqualORCondition', kicking off acquire phase on members. 2014-06-15 07:45:47,485 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,485 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,486 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,486 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,487 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,487 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,487 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,487 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,487 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,487 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,487 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,487 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:47,487 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,487 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,490 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,490 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,490 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,490 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,491 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityExpressionWithNotEqualORCondition' with timeout 60000ms 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,491 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,491 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:47,492 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityExpressionWithNotEqualORCondition' with timeout 60000ms 2014-06-15 07:45:47,492 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,492 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:47,494 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'acquire' stage 2014-06-15 07:45:47,495 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'acquire' stage 2014-06-15 07:45:47,495 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally acquired 2014-06-15 07:45:47,492 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityExpressionWithNotEqualORCondition' with timeout 60000ms 2014-06-15 07:45:47,495 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:47,495 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool13-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,495 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'acquire' stage 2014-06-15 07:45:47,495 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool13-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. started... 2014-06-15 07:45:47,496 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally acquired 2014-06-15 07:45:47,495 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityExpressionWithNotEqualORCondition) in zk 2014-06-15 07:45:47,496 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool13-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17., current region memstore size 280 B 2014-06-15 07:45:47,496 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityExpressionWithNotEqualORCondition) in zk 2014-06-15 07:45:47,495 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:47,496 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:47,499 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,499 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,500 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,500 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:47,500 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,500 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:47,523 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:47,525 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:47,527 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool13-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=7, memsize=280, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/.tmp/b175c01f681e4615bdc78641c641a7a1 2014-06-15 07:45:47,547 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool13-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/.tmp/b175c01f681e4615bdc78641c641a7a1 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/info/b175c01f681e4615bdc78641c641a7a1 2014-06-15 07:45:47,566 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool13-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/info/b175c01f681e4615bdc78641c641a7a1, entries=2, sequenceid=7, filesize=4.9 K 2014-06-15 07:45:47,568 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool13-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~280 B/280, currentsize=0 B/0 for region testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. in 72ms, sequenceid=7, compaction requested=false 2014-06-15 07:45:47,569 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool13-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,569 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:47,570 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:47,570 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,570 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally acquired 2014-06-15 07:45:47,570 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityExpressionWithNotEqualORCondition) in zk 2014-06-15 07:45:47,572 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,572 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,572 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:47,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:47,573 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,573 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:47,574 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:47,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,577 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,577 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:47,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:47,579 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityExpressionWithNotEqualORCondition' on coordinator 2014-06-15 07:45:47,579 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1a3954[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:47,579 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'in-barrier' execution. 2014-06-15 07:45:47,579 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,581 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,581 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,582 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,582 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,582 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' received 'reached' from coordinator. 2014-06-15 07:45:47,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,582 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally completed 2014-06-15 07:45:47,581 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,583 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityExpressionWithNotEqualORCondition' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:47,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:47,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:47,582 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' received 'reached' from coordinator. 2014-06-15 07:45:47,583 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally completed 2014-06-15 07:45:47,582 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,584 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityExpressionWithNotEqualORCondition' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:47,583 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,584 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:47,584 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,584 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' received 'reached' from coordinator. 2014-06-15 07:45:47,584 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally completed 2014-06-15 07:45:47,584 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityExpressionWithNotEqualORCondition' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:47,585 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' has notified controller of completion 2014-06-15 07:45:47,585 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:47,585 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,585 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' completed. 2014-06-15 07:45:47,587 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' has notified controller of completion 2014-06-15 07:45:47,587 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,587 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:47,588 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' completed. 2014-06-15 07:45:47,588 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' has notified controller of completion 2014-06-15 07:45:47,588 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:47,588 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' completed. 2014-06-15 07:45:47,589 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,589 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,590 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:47,590 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:47,591 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,591 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,592 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,592 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,593 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityExpressionWithNotEqualORCondition' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:47,593 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,593 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,593 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,593 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:47,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:47,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:47,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,595 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,595 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,596 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,596 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:47,597 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:47,597 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,597 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,598 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,599 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,600 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityExpressionWithNotEqualORCondition' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:47,600 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityExpressionWithNotEqualORCondition', counting down latch. Waiting for 0 more 2014-06-15 07:45:47,600 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityExpressionWithNotEqualORCondition' execution completed 2014-06-15 07:45:47,600 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:47,600 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:47,600 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,600 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityExpressionWithNotEqualORConditionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:47,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,608 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,608 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,608 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,608 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,608 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,609 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,639 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:47,639 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityExpressionWithNotEqualORCondition' 2014-06-15 07:45:47,639 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:47,640 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityExpressionWithNotEqualORCondition'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:47,640 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:47,740 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:47,742 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:47,743 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0016, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,755 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:47,756 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,757 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:47,758 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:47,759 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0018 connected 2014-06-15 07:45:47,774 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:47,774 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,776 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:47,776 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:47,777 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0019 connected 2014-06-15 07:45:47,782 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0019, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:47,786 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:47,790 DEBUG [RpcServer.handler=0,port=45812] procedure.ProcedureCoordinator(158): Procedure testVisibilityExpressionWithNotEqualORCondition was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:47,790 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityExpressionWithNotEqualORCondition' 2014-06-15 07:45:47,791 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:47,791 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'acquire' 2014-06-15 07:45:47,791 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityExpressionWithNotEqualORCondition', kicking off acquire phase on members. 2014-06-15 07:45:47,792 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,792 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,794 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,794 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,794 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,794 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,794 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,794 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,794 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,794 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,795 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,794 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,795 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,795 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,795 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:47,795 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,796 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,796 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,797 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:47,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:47,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:47,797 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,798 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,798 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,798 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityExpressionWithNotEqualORCondition is still present, removing 2014-06-15 07:45:47,798 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityExpressionWithNotEqualORCondition is still present, removing 2014-06-15 07:45:47,798 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,798 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,799 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityExpressionWithNotEqualORCondition' with timeout 60000ms 2014-06-15 07:45:47,799 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityExpressionWithNotEqualORCondition' with timeout 60000ms 2014-06-15 07:45:47,799 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:47,799 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:47,799 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityExpressionWithNotEqualORCondition is still present, removing 2014-06-15 07:45:47,799 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,800 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityExpressionWithNotEqualORCondition' with timeout 60000ms 2014-06-15 07:45:47,800 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'acquire' stage 2014-06-15 07:45:47,800 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:47,800 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:47,802 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool15-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,800 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'acquire' stage 2014-06-15 07:45:47,802 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool15-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. started... 2014-06-15 07:45:47,802 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally acquired 2014-06-15 07:45:47,802 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityExpressionWithNotEqualORCondition) in zk 2014-06-15 07:45:47,802 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool15-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17., current region memstore size 136 B 2014-06-15 07:45:47,802 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'acquire' stage 2014-06-15 07:45:47,802 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:47,803 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally acquired 2014-06-15 07:45:47,803 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityExpressionWithNotEqualORCondition) in zk 2014-06-15 07:45:47,806 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,818 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,818 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,818 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:47,819 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,819 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:47,836 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:47,838 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:47,842 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool15-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=10, memsize=136, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/.tmp/e1a8b4c4456a462994abf2940247dc22 2014-06-15 07:45:47,861 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool15-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/.tmp/e1a8b4c4456a462994abf2940247dc22 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/info/e1a8b4c4456a462994abf2940247dc22 2014-06-15 07:45:47,882 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool15-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityExpressionWithNotEqualORCondition/3b34b9f16dc3a089c57939b3fb3d7a17/info/e1a8b4c4456a462994abf2940247dc22, entries=1, sequenceid=10, filesize=4.8 K 2014-06-15 07:45:47,882 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool15-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. in 80ms, sequenceid=10, compaction requested=false 2014-06-15 07:45:47,882 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool15-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:45:47,882 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:47,883 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:47,883 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,883 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally acquired 2014-06-15 07:45:47,883 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityExpressionWithNotEqualORCondition) in zk 2014-06-15 07:45:47,886 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,887 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,887 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,887 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,887 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,887 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:47,887 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:47,888 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,888 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:47,888 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:47,888 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,889 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,889 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:47,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:47,891 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityExpressionWithNotEqualORCondition' on coordinator 2014-06-15 07:45:47,891 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@decb6a[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:47,891 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityExpressionWithNotEqualORCondition' starting 'in-barrier' execution. 2014-06-15 07:45:47,892 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,893 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,893 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,893 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,893 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,894 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,893 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,894 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' received 'reached' from coordinator. 2014-06-15 07:45:47,894 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally completed 2014-06-15 07:45:47,894 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityExpressionWithNotEqualORCondition' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:47,894 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,895 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' received 'reached' from coordinator. 2014-06-15 07:45:47,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,895 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally completed 2014-06-15 07:45:47,895 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' received 'reached' from coordinator. 2014-06-15 07:45:47,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,895 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' locally completed 2014-06-15 07:45:47,895 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityExpressionWithNotEqualORCondition' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:47,895 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityExpressionWithNotEqualORCondition' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:47,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:47,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:47,897 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' has notified controller of completion 2014-06-15 07:45:47,897 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:47,897 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' completed. 2014-06-15 07:45:47,898 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:47,898 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' has notified controller of completion 2014-06-15 07:45:47,898 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:47,899 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' completed. 2014-06-15 07:45:47,901 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' has notified controller of completion 2014-06-15 07:45:47,901 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:47,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,901 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityExpressionWithNotEqualORCondition' completed. 2014-06-15 07:45:47,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:47,905 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:47,905 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,906 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,906 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,907 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,908 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityExpressionWithNotEqualORCondition' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:47,908 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,908 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,908 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,908 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityExpressionWithNotEqualORCondition/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,908 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:47,908 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:47,909 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:47,909 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,910 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,910 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,911 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,911 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:47,912 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:47,913 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,914 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:47,914 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:47,915 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:47,916 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityExpressionWithNotEqualORCondition' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:47,916 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityExpressionWithNotEqualORCondition', counting down latch. Waiting for 0 more 2014-06-15 07:45:47,916 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityExpressionWithNotEqualORCondition' execution completed 2014-06-15 07:45:47,916 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:47,916 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:47,916 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityExpressionWithNotEqualORCondition 2014-06-15 07:45:47,916 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityExpressionWithNotEqualORConditionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:47,924 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,924 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,924 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,925 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,925 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,925 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,925 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:47,925 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:47,925 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:47,937 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:47,937 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityExpressionWithNotEqualORCondition' 2014-06-15 07:45:47,937 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:47,938 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityExpressionWithNotEqualORCondition'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:47,938 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:48,038 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:48,041 DEBUG [RpcServer.handler=2,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:48,041 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0018, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:48,052 ERROR [RpcServer.handler=3,port=57332] ipc.RpcServer(2042): Unexpected throwable object java.lang.AssertionError at org.apache.hadoop.hbase.security.visibility.VisibilityScanDeleteTracker.isDeleted(VisibilityScanDeleteTracker.java:235) at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:366) at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:490) at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:139) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3893) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3973) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3842) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3833) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:1948) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29497) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2005) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:221) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:43) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:162) at java.lang.Thread.run(Thread.java:662) 2014-06-15 07:45:48,375 ERROR [RpcServer.handler=2,port=57332] ipc.RpcServer(2042): Unexpected throwable object java.lang.AssertionError at org.apache.hadoop.hbase.security.visibility.VisibilityScanDeleteTracker.isDeleted(VisibilityScanDeleteTracker.java:235) at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:366) at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:490) at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:139) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3893) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3973) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3842) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3833) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:1948) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29497) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2005) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:221) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:43) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:162) at java.lang.Thread.run(Thread.java:662) 2014-06-15 07:45:48,708 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityExpressionWithNotEqualORCondition Thread=365 (was 362) Potentially hanging thread: RS_OPEN_REGION-asf008:57332-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:39356 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: AM.ZK.Worker-pool3-t20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:35163 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: AM.ZK.Worker-pool3-t19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:39339 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=523 (was 517) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=652 (was 652), ProcessCount=176 (was 176), AvailableMemoryMB=3106 (was 3193), ConnectionCount=8 (was 8) 2014-06-15 07:45:48,730 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnLatestWithNoCellVisibility Thread=366, OpenFileDescriptor=525, MaxFileDescriptor=60000, SystemLoadAverage=652, ProcessCount=176, AvailableMemoryMB=3106, ConnectionCount=8 2014-06-15 07:45:48,799 DEBUG [RpcServer.handler=0,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:48,801 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:48,805 INFO [RpcServer.handler=3,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnLatestWithNoCellVisibility', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:48,812 DEBUG [RpcServer.handler=3,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnLatestWithNoCellVisibility/write-master:458120000000000 2014-06-15 07:45:48,820 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:48,842 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:48,844 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:48,857 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnLatestWithNoCellVisibility/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:48,859 INFO [RegionOpenAndInitThread-testDeleteColumnLatestWithNoCellVisibility-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnLatestWithNoCellVisibility HTD == 'testDeleteColumnLatestWithNoCellVisibility', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:48,879 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:48,882 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741846_1022 size 75 2014-06-15 07:45:48,883 DEBUG [RegionOpenAndInitThread-testDeleteColumnLatestWithNoCellVisibility-1] regionserver.HRegion(646): Instantiated testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:48,884 DEBUG [RegionOpenAndInitThread-testDeleteColumnLatestWithNoCellVisibility-1] regionserver.HRegion(1116): Closing testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3.: disabling compactions & flushes 2014-06-15 07:45:48,884 DEBUG [RegionOpenAndInitThread-testDeleteColumnLatestWithNoCellVisibility-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:48,884 INFO [RegionOpenAndInitThread-testDeleteColumnLatestWithNoCellVisibility-1] regionserver.HRegion(1225): Closed testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:48,892 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:48,893 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:48,893 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 2828be108bd16771064395ae635dd4b3 with OFFLINE state 2014-06-15 07:45:48,894 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:48,894 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={2828be108bd16771064395ae635dd4b3 state=OFFLINE, ts=1402818348892, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:48,895 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={2828be108bd16771064395ae635dd4b3 state=OFFLINE, ts=1402818348892, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:48,898 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:48,898 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {2828be108bd16771064395ae635dd4b3 state=OFFLINE, ts=1402818348893, server=null} to {2828be108bd16771064395ae635dd4b3 state=PENDING_OPEN, ts=1402818348898, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:48,900 INFO [Priority.RpcServer.handler=1,port=47197] regionserver.RSRpcServices(1230): Open testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:48,908 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:48,909 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 2828be108bd16771064395ae635dd4b3 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:48,909 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnLatestWithNoCellVisibility state from ENABLING to ENABLED 2014-06-15 07:45:48,940 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/2828be108bd16771064395ae635dd4b3 2014-06-15 07:45:48,940 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 2828be108bd16771064395ae635dd4b3 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:48,943 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnLatestWithNoCellVisibility/write-master:458120000000000 2014-06-15 07:45:48,943 DEBUG [AM.ZK.Worker-pool3-t5] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=2828be108bd16771064395ae635dd4b3, current_state={2828be108bd16771064395ae635dd4b3 state=PENDING_OPEN, ts=1402818348898, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:48,943 INFO [AM.ZK.Worker-pool3-t5] master.RegionStates(813): Transition {2828be108bd16771064395ae635dd4b3 state=PENDING_OPEN, ts=1402818348898, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {2828be108bd16771064395ae635dd4b3 state=OPENING, ts=1402818348943, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:48,944 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(4462): Opening region: {ENCODED => 2828be108bd16771064395ae635dd4b3, NAME => 'testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:48,945 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. service=VisibilityLabelsService 2014-06-15 07:45:48,945 INFO [RS_OPEN_REGION-asf008:47197-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:48,945 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnLatestWithNoCellVisibility 2828be108bd16771064395ae635dd4b3 2014-06-15 07:45:48,946 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(646): Instantiated testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:48,954 INFO [StoreOpener-2828be108bd16771064395ae635dd4b3-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:48,955 INFO [StoreOpener-2828be108bd16771064395ae635dd4b3-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:48,956 DEBUG [StoreOpener-2828be108bd16771064395ae635dd4b3-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/info 2014-06-15 07:45:48,958 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3 2014-06-15 07:45:48,960 INFO [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(747): Onlined 2828be108bd16771064395ae635dd4b3; next sequenceid=2 2014-06-15 07:45:48,960 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 2828be108bd16771064395ae635dd4b3 2014-06-15 07:45:48,964 INFO [PostOpenDeployTasks:2828be108bd16771064395ae635dd4b3] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:48,970 INFO [PostOpenDeployTasks:2828be108bd16771064395ae635dd4b3] catalog.MetaEditor(464): Updated row testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:48,971 DEBUG [PostOpenDeployTasks:2828be108bd16771064395ae635dd4b3] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:48,971 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 2828be108bd16771064395ae635dd4b3 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:48,973 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/2828be108bd16771064395ae635dd4b3 2014-06-15 07:45:48,973 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 2828be108bd16771064395ae635dd4b3 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:48,974 DEBUG [RS_OPEN_REGION-asf008:47197-1] coordination.ZkOpenRegionCoordination(91): Transitioned 2828be108bd16771064395ae635dd4b3 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:48,974 DEBUG [RS_OPEN_REGION-asf008:47197-1] handler.OpenRegionHandler(167): Opened testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:48,974 DEBUG [AM.ZK.Worker-pool3-t7] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=2828be108bd16771064395ae635dd4b3, current_state={2828be108bd16771064395ae635dd4b3 state=OPENING, ts=1402818348943, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:48,974 INFO [AM.ZK.Worker-pool3-t7] master.RegionStates(813): Transition {2828be108bd16771064395ae635dd4b3 state=OPENING, ts=1402818348943, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {2828be108bd16771064395ae635dd4b3 state=OPEN, ts=1402818348974, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:48,974 DEBUG [AM.ZK.Worker-pool3-t7] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 2828be108bd16771064395ae635dd4b3 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:48,976 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/2828be108bd16771064395ae635dd4b3 2014-06-15 07:45:48,976 DEBUG [AM.ZK.Worker-pool3-t7] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 2828be108bd16771064395ae635dd4b3 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:48,976 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:48,976 DEBUG [AM.ZK.Worker-pool3-t7] master.AssignmentManager$4(1293): Znode testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. deleted, state: {2828be108bd16771064395ae635dd4b3 state=OPEN, ts=1402818348974, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:48,976 INFO [AM.ZK.Worker-pool3-t7] master.RegionStates(359): Onlined 2828be108bd16771064395ae635dd4b3 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,151 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:49,152 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,155 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:49,156 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:49,157 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001a connected 2014-06-15 07:45:49,162 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,183 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:49,183 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,185 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:49,186 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:49,187 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001b connected 2014-06-15 07:45:49,199 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:49,200 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,201 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:49,202 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:49,203 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001c connected 2014-06-15 07:45:49,207 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,210 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:49,214 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnLatestWithNoCellVisibility' 2014-06-15 07:45:49,214 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:49,215 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' 2014-06-15 07:45:49,215 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnLatestWithNoCellVisibility', kicking off acquire phase on members. 2014-06-15 07:45:49,215 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,216 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,217 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,217 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,217 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,217 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,217 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,218 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,218 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,218 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,218 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:49,218 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,217 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,218 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,218 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,219 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,219 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,219 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,220 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,220 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,220 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:49,221 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,220 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:49,221 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,221 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,221 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,221 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,221 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:49,221 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,222 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,222 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:49,221 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:49,222 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:49,222 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,222 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:49,222 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:49,223 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,222 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:49,223 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:49,223 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:49,223 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:49,223 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:49,223 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:49,223 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:49,225 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:49,225 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:49,225 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool20-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:49,225 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:49,225 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool20-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. started... 2014-06-15 07:45:49,226 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool20-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3., current region memstore size 712 B 2014-06-15 07:45:49,226 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,227 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,227 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,227 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:49,227 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,228 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:49,245 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:49,246 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:49,248 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool20-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/.tmp/a340516824c5409c9bfcebbf4922404f 2014-06-15 07:45:49,259 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool20-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/.tmp/a340516824c5409c9bfcebbf4922404f as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/info/a340516824c5409c9bfcebbf4922404f 2014-06-15 07:45:49,273 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool20-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/info/a340516824c5409c9bfcebbf4922404f, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:45:49,274 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool20-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. in 48ms, sequenceid=13, compaction requested=false 2014-06-15 07:45:49,274 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool20-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:49,274 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:49,274 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:49,274 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,274 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:49,275 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:49,276 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,276 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,277 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,277 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,277 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,277 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:49,277 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:49,277 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,277 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:49,277 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:49,278 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,278 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:49,279 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,279 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:49,279 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:49,280 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:49,280 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnLatestWithNoCellVisibility' on coordinator 2014-06-15 07:45:49,280 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1678aef[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:49,280 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'in-barrier' execution. 2014-06-15 07:45:49,281 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,282 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,282 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,282 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,282 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,282 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,282 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:49,282 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,282 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,283 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,283 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:49,283 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:49,283 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:49,283 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:49,283 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:49,283 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:49,282 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,284 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,284 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:49,284 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:49,284 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,284 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:49,284 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:49,284 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:49,285 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,286 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:49,286 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:49,286 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:49,287 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:49,287 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:49,287 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:49,287 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:49,289 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:49,289 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,289 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:49,289 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:49,290 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:49,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:49,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:49,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,292 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:49,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:49,294 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnLatestWithNoCellVisibility' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:49,294 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,294 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,294 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,294 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,294 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:49,294 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:49,296 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:49,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:49,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:49,299 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:49,299 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:49,300 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,300 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:49,301 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,301 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:49,302 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnLatestWithNoCellVisibility' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:45:49,302 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnLatestWithNoCellVisibility', counting down latch. Waiting for 0 more 2014-06-15 07:45:49,302 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnLatestWithNoCellVisibility' execution completed 2014-06-15 07:45:49,302 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:49,302 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:49,302 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,302 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnLatestWithNoCellVisibilityincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:49,309 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,309 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,309 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,309 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,310 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,310 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,310 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,309 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,310 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,317 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:49,317 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnLatestWithNoCellVisibility' 2014-06-15 07:45:49,318 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:49,318 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnLatestWithNoCellVisibility'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:49,318 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:49,419 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:49,420 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:49,421 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,436 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:49,437 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,442 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:49,444 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:49,445 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001d connected 2014-06-15 07:45:49,454 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:49,454 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,456 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:49,456 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:49,457 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001e connected 2014-06-15 07:45:49,460 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:49,469 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:49,474 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnLatestWithNoCellVisibility was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:49,474 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnLatestWithNoCellVisibility' 2014-06-15 07:45:49,474 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:49,475 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' 2014-06-15 07:45:49,475 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnLatestWithNoCellVisibility', kicking off acquire phase on members. 2014-06-15 07:45:49,476 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,476 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,479 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,479 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,479 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,479 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,479 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:49,479 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,479 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:49,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,479 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:49,480 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:49,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:49,480 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,480 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,481 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,481 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,481 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,481 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:49,481 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,481 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:49,482 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,482 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,481 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,482 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,482 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:49,482 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnLatestWithNoCellVisibility is still present, removing 2014-06-15 07:45:49,482 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,482 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,483 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,483 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:49,482 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnLatestWithNoCellVisibility is still present, removing 2014-06-15 07:45:49,483 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnLatestWithNoCellVisibility is still present, removing 2014-06-15 07:45:49,483 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,483 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:49,483 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:49,483 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,484 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:49,484 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:49,484 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:49,484 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:49,484 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:49,485 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool22-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:49,485 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:49,485 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool22-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. started... 2014-06-15 07:45:49,485 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:49,486 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool22-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3., current region memstore size 144 B 2014-06-15 07:45:49,485 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:49,485 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:49,488 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:49,488 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:49,488 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:49,492 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,492 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,492 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,492 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:49,492 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:49,493 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:49,508 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741848_1024{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 4956 2014-06-15 07:45:49,509 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741848_1024 size 4956 2014-06-15 07:45:50,091 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool22-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/.tmp/59b464403a074167a58f3c3a73b8f05c 2014-06-15 07:45:50,109 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool22-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/.tmp/59b464403a074167a58f3c3a73b8f05c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/info/59b464403a074167a58f3c3a73b8f05c 2014-06-15 07:45:50,135 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool22-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/info/59b464403a074167a58f3c3a73b8f05c, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:45:50,135 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool22-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. in 649ms, sequenceid=16, compaction requested=false 2014-06-15 07:45:50,136 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool22-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:50,136 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:50,136 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:50,136 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,136 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:50,136 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:50,139 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,139 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,139 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,139 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,139 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:50,140 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:50,140 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,140 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,141 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:50,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:50,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,144 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:50,144 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:50,145 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnLatestWithNoCellVisibility' on coordinator 2014-06-15 07:45:50,145 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@b34bf3[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:50,145 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'in-barrier' execution. 2014-06-15 07:45:50,146 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,147 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,148 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,148 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,148 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,148 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,148 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:50,148 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:50,148 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:50,148 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,149 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,148 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,149 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,149 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,149 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:50,149 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:50,149 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:50,149 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:50,149 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:50,149 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:50,150 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:50,150 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:50,148 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,150 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:50,154 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:50,154 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:50,154 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:50,155 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,157 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:50,158 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:50,158 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:50,159 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:50,159 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:50,159 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:50,160 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,160 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,161 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,162 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:50,162 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:50,163 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,164 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,164 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,165 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,165 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnLatestWithNoCellVisibility' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:50,166 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,166 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,166 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,166 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,166 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:50,166 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:50,167 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:50,167 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,167 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,168 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,168 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,169 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:50,169 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:50,169 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,170 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,170 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,171 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,172 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnLatestWithNoCellVisibility' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:45:50,172 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnLatestWithNoCellVisibility', counting down latch. Waiting for 0 more 2014-06-15 07:45:50,172 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnLatestWithNoCellVisibility' execution completed 2014-06-15 07:45:50,172 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:50,172 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:50,172 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,172 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnLatestWithNoCellVisibilityincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:50,182 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,182 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,182 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,182 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,182 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,183 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,182 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,183 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,183 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,193 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:50,193 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnLatestWithNoCellVisibility' 2014-06-15 07:45:50,194 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:50,195 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnLatestWithNoCellVisibility'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:50,195 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:50,295 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:50,297 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:50,298 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:50,319 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:50,319 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:50,449 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:50,450 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:50,451 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001f connected 2014-06-15 07:45:50,473 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:50,473 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:50,476 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:50,477 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:50,477 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0020 connected 2014-06-15 07:45:50,483 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0020, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:50,507 INFO [RpcServer.handler=4,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:50,512 DEBUG [RpcServer.handler=4,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnLatestWithNoCellVisibility was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:50,513 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnLatestWithNoCellVisibility' 2014-06-15 07:45:50,513 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:50,514 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' 2014-06-15 07:45:50,514 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnLatestWithNoCellVisibility', kicking off acquire phase on members. 2014-06-15 07:45:50,515 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,515 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,518 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,518 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,519 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,519 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,519 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,519 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,519 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,519 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,519 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,520 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:50,519 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,519 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,520 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,520 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,521 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,521 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:50,521 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,521 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,521 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,522 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnLatestWithNoCellVisibility is still present, removing 2014-06-15 07:45:50,522 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,522 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,522 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,522 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:50,522 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:50,523 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:50,523 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:50,523 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:50,523 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:50,523 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:50,524 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,524 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,523 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:50,524 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. started... 2014-06-15 07:45:50,524 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,524 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3., current region memstore size 120 B 2014-06-15 07:45:50,525 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnLatestWithNoCellVisibility is still present, removing 2014-06-15 07:45:50,525 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,525 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:50,525 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:50,524 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,525 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:50,527 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnLatestWithNoCellVisibility is still present, removing 2014-06-15 07:45:50,527 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:50,527 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,527 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:50,527 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnLatestWithNoCellVisibility' with timeout 60000ms 2014-06-15 07:45:50,527 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:50,528 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'acquire' stage 2014-06-15 07:45:50,528 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:50,528 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:50,534 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,536 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,536 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,536 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:50,537 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,537 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:50,554 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:50,558 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:50,583 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=120, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/.tmp/bdebc9113afa405f9465cafa40176e58 2014-06-15 07:45:50,597 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] regionserver.StoreFile(412): HFile Bloom filter type for bdebc9113afa405f9465cafa40176e58: NONE, but ROW specified in column family configuration 2014-06-15 07:45:50,599 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/.tmp/bdebc9113afa405f9465cafa40176e58 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/info/bdebc9113afa405f9465cafa40176e58 2014-06-15 07:45:50,614 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] regionserver.StoreFile(412): HFile Bloom filter type for bdebc9113afa405f9465cafa40176e58: NONE, but ROW specified in column family configuration 2014-06-15 07:45:50,615 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnLatestWithNoCellVisibility/2828be108bd16771064395ae635dd4b3/info/bdebc9113afa405f9465cafa40176e58, entries=0, sequenceid=19, filesize=4.4 K 2014-06-15 07:45:50,615 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~120 B/120, currentsize=0 B/0 for region testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. in 91ms, sequenceid=19, compaction requested=true 2014-06-15 07:45:50,615 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool24-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:45:50,615 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:50,615 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:50,615 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,615 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally acquired 2014-06-15 07:45:50,616 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnLatestWithNoCellVisibility) in zk 2014-06-15 07:45:50,619 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,619 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,619 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,619 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,619 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,619 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,619 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:50,619 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:50,619 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:50,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:50,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,621 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,621 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,622 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,622 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:50,623 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:50,623 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnLatestWithNoCellVisibility' on coordinator 2014-06-15 07:45:50,623 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1d4b0e9[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:50,623 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnLatestWithNoCellVisibility' starting 'in-barrier' execution. 2014-06-15 07:45:50,624 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,630 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,630 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,630 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,631 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,630 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,631 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,631 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,631 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,631 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:50,631 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:50,630 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,632 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:50,632 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,632 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:50,632 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,632 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:50,631 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:50,632 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' received 'reached' from coordinator. 2014-06-15 07:45:50,632 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:50,632 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' locally completed 2014-06-15 07:45:50,633 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:50,632 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnLatestWithNoCellVisibility' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:50,633 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:50,635 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,635 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:50,635 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:50,635 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:50,636 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:50,636 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:50,636 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' has notified controller of completion 2014-06-15 07:45:50,636 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,636 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:50,636 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:50,637 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnLatestWithNoCellVisibility' completed. 2014-06-15 07:45:50,637 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,637 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,639 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:50,640 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:50,640 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,641 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,641 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,642 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,643 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnLatestWithNoCellVisibility' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:50,643 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,643 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,643 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,643 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnLatestWithNoCellVisibility/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,643 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:50,643 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:50,644 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:50,644 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,646 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:50,646 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:50,647 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,647 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:50,648 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:50,649 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:50,650 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnLatestWithNoCellVisibility' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:45:50,650 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnLatestWithNoCellVisibility', counting down latch. Waiting for 0 more 2014-06-15 07:45:50,650 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnLatestWithNoCellVisibility' execution completed 2014-06-15 07:45:50,650 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:50,650 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:50,650 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnLatestWithNoCellVisibility 2014-06-15 07:45:50,650 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnLatestWithNoCellVisibilityincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:50,657 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,657 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,657 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,657 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,657 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,657 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,657 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:50,658 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:50,658 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:50,664 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:50,664 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnLatestWithNoCellVisibility' 2014-06-15 07:45:50,665 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:50,666 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnLatestWithNoCellVisibility'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:50,666 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:50,767 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:50,768 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:50,769 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a001f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:50,806 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnLatestWithNoCellVisibility Thread=370 (was 366) Potentially hanging thread: RS_OPEN_REGION-asf008:47197-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:35462 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:35408 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:39339 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:35449 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=545 (was 525) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=616 (was 652), ProcessCount=176 (was 176), AvailableMemoryMB=2998 (was 3106), ConnectionCount=8 (was 8) 2014-06-15 07:45:50,832 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilyLatestTimeStampWithMulipleVersions Thread=370, OpenFileDescriptor=547, MaxFileDescriptor=60000, SystemLoadAverage=616, ProcessCount=176, AvailableMemoryMB=2997, ConnectionCount=8 2014-06-15 07:45:50,864 DEBUG [RpcServer.handler=2,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:50,866 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:50,870 INFO [RpcServer.handler=0,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteFamilyLatestTimeStampWithMulipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:50,892 DEBUG [RpcServer.handler=0,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteFamilyLatestTimeStampWithMulipleVersions/write-master:458120000000000 2014-06-15 07:45:50,901 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:50,957 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:50,959 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:50,970 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:50,973 INFO [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersions-1] regionserver.HRegion(4277): creating HRegion testDeleteFamilyLatestTimeStampWithMulipleVersions HTD == 'testDeleteFamilyLatestTimeStampWithMulipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:50,996 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:50,998 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:51,004 DEBUG [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersions-1] regionserver.HRegion(646): Instantiated testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,004 DEBUG [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersions-1] regionserver.HRegion(1116): Closing testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f.: disabling compactions & flushes 2014-06-15 07:45:51,004 DEBUG [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersions-1] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,004 INFO [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersions-1] regionserver.HRegion(1225): Closed testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,012 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:51,013 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,013 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 12ce04b663b94fe6d3dd358b67f5e74f with OFFLINE state 2014-06-15 07:45:51,015 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:51,015 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={12ce04b663b94fe6d3dd358b67f5e74f state=OFFLINE, ts=1402818351013, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,015 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={12ce04b663b94fe6d3dd358b67f5e74f state=OFFLINE, ts=1402818351013, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,019 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:51,019 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {12ce04b663b94fe6d3dd358b67f5e74f state=OFFLINE, ts=1402818351013, server=null} to {12ce04b663b94fe6d3dd358b67f5e74f state=PENDING_OPEN, ts=1402818351019, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:51,020 INFO [Priority.RpcServer.handler=2,port=47197] regionserver.RSRpcServices(1230): Open testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,029 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,030 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteFamilyLatestTimeStampWithMulipleVersions state from ENABLING to ENABLED 2014-06-15 07:45:51,031 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 12ce04b663b94fe6d3dd358b67f5e74f from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:51,035 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/12ce04b663b94fe6d3dd358b67f5e74f 2014-06-15 07:45:51,036 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 12ce04b663b94fe6d3dd358b67f5e74f from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:51,037 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteFamilyLatestTimeStampWithMulipleVersions/write-master:458120000000000 2014-06-15 07:45:51,037 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(4462): Opening region: {ENCODED => 12ce04b663b94fe6d3dd358b67f5e74f, NAME => 'testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:51,037 DEBUG [AM.ZK.Worker-pool3-t10] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=12ce04b663b94fe6d3dd358b67f5e74f, current_state={12ce04b663b94fe6d3dd358b67f5e74f state=PENDING_OPEN, ts=1402818351019, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:51,038 INFO [AM.ZK.Worker-pool3-t10] master.RegionStates(813): Transition {12ce04b663b94fe6d3dd358b67f5e74f state=PENDING_OPEN, ts=1402818351019, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {12ce04b663b94fe6d3dd358b67f5e74f state=OPENING, ts=1402818351037, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:51,038 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. service=VisibilityLabelsService 2014-06-15 07:45:51,038 INFO [RS_OPEN_REGION-asf008:47197-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:51,038 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteFamilyLatestTimeStampWithMulipleVersions 12ce04b663b94fe6d3dd358b67f5e74f 2014-06-15 07:45:51,038 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(646): Instantiated testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,049 INFO [StoreOpener-12ce04b663b94fe6d3dd358b67f5e74f-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:51,050 INFO [StoreOpener-12ce04b663b94fe6d3dd358b67f5e74f-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:51,051 DEBUG [StoreOpener-12ce04b663b94fe6d3dd358b67f5e74f-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/info 2014-06-15 07:45:51,053 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f 2014-06-15 07:45:51,055 INFO [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(747): Onlined 12ce04b663b94fe6d3dd358b67f5e74f; next sequenceid=2 2014-06-15 07:45:51,055 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 12ce04b663b94fe6d3dd358b67f5e74f 2014-06-15 07:45:51,057 INFO [PostOpenDeployTasks:12ce04b663b94fe6d3dd358b67f5e74f] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,063 INFO [PostOpenDeployTasks:12ce04b663b94fe6d3dd358b67f5e74f] catalog.MetaEditor(464): Updated row testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,063 DEBUG [PostOpenDeployTasks:12ce04b663b94fe6d3dd358b67f5e74f] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,064 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 12ce04b663b94fe6d3dd358b67f5e74f from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:51,099 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/12ce04b663b94fe6d3dd358b67f5e74f 2014-06-15 07:45:51,099 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 12ce04b663b94fe6d3dd358b67f5e74f from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:51,099 DEBUG [RS_OPEN_REGION-asf008:47197-2] coordination.ZkOpenRegionCoordination(91): Transitioned 12ce04b663b94fe6d3dd358b67f5e74f to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,099 DEBUG [RS_OPEN_REGION-asf008:47197-2] handler.OpenRegionHandler(167): Opened testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,100 DEBUG [AM.ZK.Worker-pool3-t11] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=12ce04b663b94fe6d3dd358b67f5e74f, current_state={12ce04b663b94fe6d3dd358b67f5e74f state=OPENING, ts=1402818351037, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:51,100 INFO [AM.ZK.Worker-pool3-t11] master.RegionStates(813): Transition {12ce04b663b94fe6d3dd358b67f5e74f state=OPENING, ts=1402818351037, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {12ce04b663b94fe6d3dd358b67f5e74f state=OPEN, ts=1402818351100, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:51,100 DEBUG [AM.ZK.Worker-pool3-t11] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 12ce04b663b94fe6d3dd358b67f5e74f from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:51,103 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/12ce04b663b94fe6d3dd358b67f5e74f 2014-06-15 07:45:51,103 DEBUG [AM.ZK.Worker-pool3-t11] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 12ce04b663b94fe6d3dd358b67f5e74f in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:51,103 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:51,104 DEBUG [AM.ZK.Worker-pool3-t11] master.AssignmentManager$4(1293): Znode testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. deleted, state: {12ce04b663b94fe6d3dd358b67f5e74f state=OPEN, ts=1402818351100, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:45:51,104 INFO [AM.ZK.Worker-pool3-t11] master.RegionStates(359): Onlined 12ce04b663b94fe6d3dd358b67f5e74f on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,231 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:51,231 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,234 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:51,235 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:51,236 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0021 connected 2014-06-15 07:45:51,239 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0021, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,258 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:51,258 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,260 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:51,260 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:51,261 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0022 connected 2014-06-15 07:45:51,272 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:51,272 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,274 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:51,274 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:51,275 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0023 connected 2014-06-15 07:45:51,280 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0023, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,284 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:51,320 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' 2014-06-15 07:45:51,320 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,320 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' 2014-06-15 07:45:51,320 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:45:51,321 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,321 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,323 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,323 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,323 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,323 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,323 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,323 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,323 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,324 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,324 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:51,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,325 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,325 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,325 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,326 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,326 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,327 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,327 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,327 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,327 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,327 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,327 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,329 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,327 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,330 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,327 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,331 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:51,330 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,331 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,331 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,331 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:51,331 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,331 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool29-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,332 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,332 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool29-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. started... 2014-06-15 07:45:51,333 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,333 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,333 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool29-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f., current region memstore size 712 B 2014-06-15 07:45:51,333 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,334 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,335 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,335 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,336 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,336 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,336 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,355 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:51,356 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:51,361 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool29-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/.tmp/4f3b3a2ccdc14d2a855b6e32aa417663 2014-06-15 07:45:51,377 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool29-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/.tmp/4f3b3a2ccdc14d2a855b6e32aa417663 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/info/4f3b3a2ccdc14d2a855b6e32aa417663 2014-06-15 07:45:51,392 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool29-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/info/4f3b3a2ccdc14d2a855b6e32aa417663, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:45:51,392 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool29-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. in 59ms, sequenceid=13, compaction requested=false 2014-06-15 07:45:51,392 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool29-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,392 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:51,393 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:51,393 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,393 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,393 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,396 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,396 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,396 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,396 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,396 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,396 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:51,396 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:51,397 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,397 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,397 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:51,397 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,398 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,399 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,399 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,400 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:51,400 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:51,401 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' on coordinator 2014-06-15 07:45:51,401 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@170bdf7[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:51,401 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:45:51,401 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,402 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,403 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,403 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,403 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,403 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,403 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,403 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,403 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,403 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,403 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,403 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:51,403 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,403 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,403 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,404 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,404 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,404 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:51,404 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:51,404 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,405 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,405 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:51,404 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:51,406 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:51,406 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:51,406 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:51,406 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:51,408 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:51,408 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:51,408 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:51,408 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:51,408 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:51,408 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,409 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:51,409 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,410 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,410 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,410 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:51,411 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:51,411 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,412 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,412 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,412 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,413 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilyLatestTimeStampWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:51,413 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,413 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,413 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,413 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,414 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:51,414 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:51,414 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:51,414 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,415 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,415 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,416 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,416 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:51,416 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:51,417 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,417 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,418 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,418 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,419 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:45:51,419 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteFamilyLatestTimeStampWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:45:51,419 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' execution completed 2014-06-15 07:45:51,419 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:51,420 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:51,420 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,420 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilyLatestTimeStampWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:51,426 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,426 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,426 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,426 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,426 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,426 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,427 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,426 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,427 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,434 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:51,434 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilyLatestTimeStampWithMulipleVersions' 2014-06-15 07:45:51,435 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:51,435 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilyLatestTimeStampWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:51,435 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:51,536 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:51,537 DEBUG [RpcServer.handler=2,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:51,538 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0022, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,546 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:51,546 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,549 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:51,549 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:51,550 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0024 connected 2014-06-15 07:45:51,561 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:51,561 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,563 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:51,564 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:51,565 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0025 connected 2014-06-15 07:45:51,568 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0025, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,572 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:51,576 DEBUG [RpcServer.handler=3,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteFamilyLatestTimeStampWithMulipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:51,576 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' 2014-06-15 07:45:51,576 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,577 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' 2014-06-15 07:45:51,577 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:45:51,577 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,578 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,579 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,579 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,579 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,579 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,579 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,580 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,580 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,582 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,582 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,582 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,582 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:51,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,583 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,583 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,583 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:45:51,584 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,584 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,584 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:45:51,584 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,584 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,584 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,584 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,584 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,584 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,586 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,585 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,586 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,586 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:45:51,586 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool31-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,587 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,587 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool31-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. started... 2014-06-15 07:45:51,587 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,586 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,586 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:51,587 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,587 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool31-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f., current region memstore size 144 B 2014-06-15 07:45:51,587 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,587 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,588 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,588 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,587 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:51,588 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,614 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,616 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,616 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,616 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,617 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,617 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,638 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:51,642 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:51,645 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool31-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/.tmp/acfc95ab0b474bbdaa465b734176a9c3 2014-06-15 07:45:51,660 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool31-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/.tmp/acfc95ab0b474bbdaa465b734176a9c3 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/info/acfc95ab0b474bbdaa465b734176a9c3 2014-06-15 07:45:51,677 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool31-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/info/acfc95ab0b474bbdaa465b734176a9c3, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:45:51,677 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool31-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. in 90ms, sequenceid=16, compaction requested=false 2014-06-15 07:45:51,679 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool31-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,679 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:51,679 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:51,679 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,680 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,680 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,683 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,683 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,683 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,683 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,683 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,683 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,683 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:51,683 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,683 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:51,684 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:51,684 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,685 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,685 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,686 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,687 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:51,687 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:51,688 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' on coordinator 2014-06-15 07:45:51,688 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@27d9e5[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:51,688 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:45:51,688 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,690 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,690 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,691 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,691 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,691 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,690 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,691 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,691 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,691 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,691 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:51,692 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,692 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,692 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:51,691 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,691 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,692 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,692 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,693 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:51,693 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:51,693 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,693 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,693 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:51,693 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:51,695 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:51,696 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:51,696 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:51,697 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:51,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,696 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:51,697 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:51,700 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:51,700 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,700 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:51,701 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:51,702 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,702 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,703 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:51,703 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:51,704 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,709 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,710 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,710 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,711 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilyLatestTimeStampWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:51,711 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,711 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,712 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,712 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,712 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:51,712 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:51,712 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:51,713 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,713 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,714 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,714 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,715 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:51,715 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:51,716 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,716 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,717 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,717 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,718 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:45:51,718 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteFamilyLatestTimeStampWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:45:51,718 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' execution completed 2014-06-15 07:45:51,718 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:51,718 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:51,718 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,718 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilyLatestTimeStampWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:51,726 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,726 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,727 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,727 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,726 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,727 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,726 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,727 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,728 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,732 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:51,732 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilyLatestTimeStampWithMulipleVersions' 2014-06-15 07:45:51,732 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:51,748 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilyLatestTimeStampWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:51,748 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:51,848 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:51,850 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:51,850 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0024, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,862 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:51,862 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,866 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:51,867 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:51,868 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0026 connected 2014-06-15 07:45:51,876 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:51,877 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,878 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:51,879 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:51,880 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0027 connected 2014-06-15 07:45:51,882 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0027, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:51,886 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:51,891 DEBUG [RpcServer.handler=1,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteFamilyLatestTimeStampWithMulipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:51,891 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' 2014-06-15 07:45:51,892 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,893 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' 2014-06-15 07:45:51,893 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:45:51,894 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,894 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,896 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,896 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,896 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,896 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,896 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,896 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:51,897 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:51,897 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:51,897 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,897 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:51,897 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,897 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,897 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,898 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,898 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,898 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,898 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,898 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,898 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:51,899 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,899 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,899 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:45:51,899 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,899 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:45:51,899 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,900 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:45:51,900 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,900 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,900 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,900 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,900 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,900 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,900 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:45:51,901 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,901 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,901 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,901 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,901 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:51,902 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,902 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:45:51,902 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,903 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:51,903 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,903 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:51,903 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. started... 2014-06-15 07:45:51,903 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f., current region memstore size 128 B 2014-06-15 07:45:51,904 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,905 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,905 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,906 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,906 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,907 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,932 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:51,932 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:51,937 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=128, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/.tmp/d5d7e065f84f4de3ac74c89f41c50ec1 2014-06-15 07:45:51,950 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5d7e065f84f4de3ac74c89f41c50ec1 2014-06-15 07:45:51,953 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/.tmp/d5d7e065f84f4de3ac74c89f41c50ec1 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/info/d5d7e065f84f4de3ac74c89f41c50ec1 2014-06-15 07:45:51,970 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5d7e065f84f4de3ac74c89f41c50ec1 2014-06-15 07:45:51,970 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersions/12ce04b663b94fe6d3dd358b67f5e74f/info/d5d7e065f84f4de3ac74c89f41c50ec1, entries=1, sequenceid=19, filesize=5.0 K 2014-06-15 07:45:51,970 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~128 B/128, currentsize=0 B/0 for region testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. in 67ms, sequenceid=19, compaction requested=true 2014-06-15 07:45:51,971 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool34-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:45:51,971 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:51,971 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:51,972 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,972 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:45:51,972 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersions) in zk 2014-06-15 07:45:51,975 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,975 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,975 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,975 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,975 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,975 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:51,975 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:51,976 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,976 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:51,976 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:51,977 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,977 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:51,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:51,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:51,980 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:51,980 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' on coordinator 2014-06-15 07:45:51,980 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@a5d40f[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:51,980 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:45:51,980 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,983 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,983 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,983 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,983 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,983 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,983 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,983 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,984 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,984 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,984 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,984 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:51,984 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,984 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:51,983 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,984 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,985 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:51,985 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' locally completed 2014-06-15 07:45:51,985 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:51,985 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:51,985 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:51,986 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:51,986 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:52,012 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:52,013 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:52,013 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:52,012 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:52,015 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:52,015 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:52,015 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:45:52,015 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:52,015 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:52,016 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:52,016 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' completed. 2014-06-15 07:45:52,016 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,018 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:52,019 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:52,019 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:52,020 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,020 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,021 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,022 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilyLatestTimeStampWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:52,022 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,022 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,022 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,022 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,022 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:52,022 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:52,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:52,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:52,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,026 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:52,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:52,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:52,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,030 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:45:52,030 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteFamilyLatestTimeStampWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:45:52,030 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersions' execution completed 2014-06-15 07:45:52,031 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:52,031 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:52,031 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilyLatestTimeStampWithMulipleVersions 2014-06-15 07:45:52,031 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilyLatestTimeStampWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:52,042 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,042 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,043 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,042 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,042 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,043 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,052 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:52,052 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilyLatestTimeStampWithMulipleVersions' 2014-06-15 07:45:52,052 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:52,052 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilyLatestTimeStampWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:52,053 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:52,153 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:52,155 DEBUG [RpcServer.handler=2,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:52,155 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0026, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,195 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilyLatestTimeStampWithMulipleVersions Thread=371 (was 370) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:35542 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: RS_OPEN_REGION-asf008:47197-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:39466 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:39503 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:35449 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=551 (was 547) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=616 (was 616), ProcessCount=176 (was 176), AvailableMemoryMB=2945 (was 2997), ConnectionCount=8 (was 8) 2014-06-15 07:45:52,221 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteColumnsWithMultipleVersions Thread=371, OpenFileDescriptor=553, MaxFileDescriptor=60000, SystemLoadAverage=616, ProcessCount=176, AvailableMemoryMB=2945, ConnectionCount=8 2014-06-15 07:45:52,263 DEBUG [RpcServer.handler=3,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:52,266 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:52,270 INFO [RpcServer.handler=4,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:52,282 DEBUG [RpcServer.handler=4,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/write-master:458120000000000 2014-06-15 07:45:52,289 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,309 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:52,310 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741855_1031 size 337 2014-06-15 07:45:52,320 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:52,321 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnsWithMultipleVersions-1] regionserver.HRegion(4277): creating HRegion testVisibilityLabelsWithDeleteColumnsWithMultipleVersions HTD == 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,341 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:52,342 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:52,347 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnsWithMultipleVersions-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,347 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnsWithMultipleVersions-1] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082.: disabling compactions & flushes 2014-06-15 07:45:52,347 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnsWithMultipleVersions-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,347 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnsWithMultipleVersions-1] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,356 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:52,356 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,356 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node c383f1ec26fbb6b0da672c6525cbb082 with OFFLINE state 2014-06-15 07:45:52,358 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:52,358 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={c383f1ec26fbb6b0da672c6525cbb082 state=OFFLINE, ts=1402818352356, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,359 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={c383f1ec26fbb6b0da672c6525cbb082 state=OFFLINE, ts=1402818352356, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,362 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:52,362 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {c383f1ec26fbb6b0da672c6525cbb082 state=OFFLINE, ts=1402818352356, server=null} to {c383f1ec26fbb6b0da672c6525cbb082 state=PENDING_OPEN, ts=1402818352362, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:52,363 INFO [Priority.RpcServer.handler=2,port=57332] regionserver.RSRpcServices(1230): Open testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,371 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning c383f1ec26fbb6b0da672c6525cbb082 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:52,371 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,372 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testVisibilityLabelsWithDeleteColumnsWithMultipleVersions state from ENABLING to ENABLED 2014-06-15 07:45:52,375 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/c383f1ec26fbb6b0da672c6525cbb082 2014-06-15 07:45:52,375 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node c383f1ec26fbb6b0da672c6525cbb082 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:52,376 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(4462): Opening region: {ENCODED => c383f1ec26fbb6b0da672c6525cbb082, NAME => 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:52,377 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/write-master:458120000000000 2014-06-15 07:45:52,377 DEBUG [AM.ZK.Worker-pool3-t15] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=c383f1ec26fbb6b0da672c6525cbb082, current_state={c383f1ec26fbb6b0da672c6525cbb082 state=PENDING_OPEN, ts=1402818352362, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:52,377 INFO [AM.ZK.Worker-pool3-t15] master.RegionStates(813): Transition {c383f1ec26fbb6b0da672c6525cbb082 state=PENDING_OPEN, ts=1402818352362, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {c383f1ec26fbb6b0da672c6525cbb082 state=OPENING, ts=1402818352377, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:52,377 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(5559): Registered coprocessor service: region=testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. service=VisibilityLabelsService 2014-06-15 07:45:52,378 INFO [RS_OPEN_REGION-asf008:57332-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:52,378 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testVisibilityLabelsWithDeleteColumnsWithMultipleVersions c383f1ec26fbb6b0da672c6525cbb082 2014-06-15 07:45:52,378 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,386 INFO [StoreOpener-c383f1ec26fbb6b0da672c6525cbb082-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:52,387 INFO [StoreOpener-c383f1ec26fbb6b0da672c6525cbb082-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:52,389 DEBUG [StoreOpener-c383f1ec26fbb6b0da672c6525cbb082-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/info 2014-06-15 07:45:52,392 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082 2014-06-15 07:45:52,395 INFO [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(747): Onlined c383f1ec26fbb6b0da672c6525cbb082; next sequenceid=2 2014-06-15 07:45:52,395 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node c383f1ec26fbb6b0da672c6525cbb082 2014-06-15 07:45:52,396 INFO [PostOpenDeployTasks:c383f1ec26fbb6b0da672c6525cbb082] regionserver.HRegionServer(1663): Post open deploy tasks for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,402 INFO [PostOpenDeployTasks:c383f1ec26fbb6b0da672c6525cbb082] catalog.MetaEditor(464): Updated row testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,402 DEBUG [PostOpenDeployTasks:c383f1ec26fbb6b0da672c6525cbb082] regionserver.HRegionServer(1693): Finished post open deploy task for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,402 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning c383f1ec26fbb6b0da672c6525cbb082 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:52,439 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/c383f1ec26fbb6b0da672c6525cbb082 2014-06-15 07:45:52,439 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node c383f1ec26fbb6b0da672c6525cbb082 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:52,439 DEBUG [RS_OPEN_REGION-asf008:57332-2] coordination.ZkOpenRegionCoordination(91): Transitioned c383f1ec26fbb6b0da672c6525cbb082 to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,439 DEBUG [RS_OPEN_REGION-asf008:57332-2] handler.OpenRegionHandler(167): Opened testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,440 DEBUG [AM.ZK.Worker-pool3-t16] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=c383f1ec26fbb6b0da672c6525cbb082, current_state={c383f1ec26fbb6b0da672c6525cbb082 state=OPENING, ts=1402818352377, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:52,440 INFO [AM.ZK.Worker-pool3-t16] master.RegionStates(813): Transition {c383f1ec26fbb6b0da672c6525cbb082 state=OPENING, ts=1402818352377, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {c383f1ec26fbb6b0da672c6525cbb082 state=OPEN, ts=1402818352440, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:52,441 DEBUG [AM.ZK.Worker-pool3-t16] coordination.ZkOpenRegionCoordination(350): Handling OPENED of c383f1ec26fbb6b0da672c6525cbb082 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:52,444 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/c383f1ec26fbb6b0da672c6525cbb082 2014-06-15 07:45:52,444 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:52,444 DEBUG [AM.ZK.Worker-pool3-t16] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node c383f1ec26fbb6b0da672c6525cbb082 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:52,445 DEBUG [AM.ZK.Worker-pool3-t16] master.AssignmentManager$4(1293): Znode testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. deleted, state: {c383f1ec26fbb6b0da672c6525cbb082 state=OPEN, ts=1402818352440, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:52,445 INFO [AM.ZK.Worker-pool3-t16] master.RegionStates(359): Onlined c383f1ec26fbb6b0da672c6525cbb082 on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,604 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:52,605 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,639 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:52,640 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0028 connected 2014-06-15 07:45:52,642 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0028, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:52,653 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0028, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,682 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:52,682 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:52,688 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:52,689 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0029 connected 2014-06-15 07:45:52,700 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:52,701 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,702 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:52,707 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:52,712 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002a connected 2014-06-15 07:45:52,720 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,724 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:52,729 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' 2014-06-15 07:45:52,729 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:52,730 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' 2014-06-15 07:45:52,730 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:45:52,731 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,731 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,732 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,732 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,732 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,732 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,733 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,733 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,733 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,732 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,733 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,733 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,734 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,734 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,734 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,734 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,734 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,734 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,735 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:52,735 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:52,735 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,735 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,735 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:52,735 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,736 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,736 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:52,736 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,736 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,736 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,736 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:52,736 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,735 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,736 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:52,737 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:52,736 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:52,738 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:52,738 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,738 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:52,738 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:52,738 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:52,738 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:52,738 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:52,740 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:52,740 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:52,740 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:52,741 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:52,741 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:52,741 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool37-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,742 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool37-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. started... 2014-06-15 07:45:52,742 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool37-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082., current region memstore size 712 B 2014-06-15 07:45:52,747 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,747 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,748 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,748 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,748 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:52,748 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:52,767 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:52,768 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:52,771 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool37-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/.tmp/8a9276980c2b4fd5a85d54ef9502852e 2014-06-15 07:45:52,781 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool37-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/.tmp/8a9276980c2b4fd5a85d54ef9502852e as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/info/8a9276980c2b4fd5a85d54ef9502852e 2014-06-15 07:45:52,789 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool37-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/info/8a9276980c2b4fd5a85d54ef9502852e, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:45:52,790 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool37-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. in 48ms, sequenceid=13, compaction requested=false 2014-06-15 07:45:52,790 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool37-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,790 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:52,792 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:52,792 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,792 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:52,792 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:52,796 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,796 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,796 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:52,797 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:52,797 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:52,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:52,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,798 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,798 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,799 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,799 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:52,799 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:52,800 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' on coordinator 2014-06-15 07:45:52,800 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@6cd0f9[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:52,800 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:45:52,800 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,801 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,801 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,801 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,801 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,801 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,801 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,801 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,801 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,802 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:52,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,802 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:52,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:52,802 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:52,802 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,802 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:52,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:52,802 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:52,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,803 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:52,803 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:52,803 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:52,803 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:52,803 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:52,805 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:52,805 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:52,805 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,805 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:52,807 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:52,807 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:52,807 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:52,807 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,808 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:52,808 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,808 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:52,808 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:52,808 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,809 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:52,809 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:52,810 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,810 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,810 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,811 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,811 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:52,811 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,812 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:52,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:52,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:52,813 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,813 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,813 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,814 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,814 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:52,815 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:52,815 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,816 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:52,816 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:52,816 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,818 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:52,818 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:45:52,818 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' execution completed 2014-06-15 07:45:52,818 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:52,818 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:52,819 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,819 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteColumnsWithMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:52,824 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,825 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,825 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,825 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,825 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,825 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,825 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,825 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,826 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,831 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:52,831 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' 2014-06-15 07:45:52,831 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:52,832 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteColumnsWithMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:52,832 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:52,932 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:52,934 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:52,934 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0029, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,941 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:52,941 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,943 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:52,944 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:52,945 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002b connected 2014-06-15 07:45:52,959 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:52,959 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,961 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:52,961 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:52,963 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002c connected 2014-06-15 07:45:52,966 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:52,969 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:52,973 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testVisibilityLabelsWithDeleteColumnsWithMultipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:52,973 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' 2014-06-15 07:45:52,973 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:52,973 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' 2014-06-15 07:45:52,973 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:45:52,974 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,974 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,976 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,976 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,976 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,976 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,976 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,976 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,976 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,976 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:52,977 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:52,977 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:52,977 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:52,977 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:52,977 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,978 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,978 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:52,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:52,978 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,979 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,979 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,980 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:52,980 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,980 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,980 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnsWithMultipleVersions is still present, removing 2014-06-15 07:45:52,980 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,980 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:52,980 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnsWithMultipleVersions is still present, removing 2014-06-15 07:45:52,980 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnsWithMultipleVersions is still present, removing 2014-06-15 07:45:52,980 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,980 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:52,981 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:52,981 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:52,981 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:52,981 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:52,981 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:52,980 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:52,981 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:52,981 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:52,982 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:52,982 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool39-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:52,982 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:52,982 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool39-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. started... 2014-06-15 07:45:52,982 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:52,982 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:52,982 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool39-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082., current region memstore size 144 B 2014-06-15 07:45:52,982 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:52,983 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:53,025 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,027 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:53,027 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,027 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:53,035 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:53,037 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741858_1034 size 4956 2014-06-15 07:45:53,038 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool39-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/.tmp/b09985ace4e24213a61dc3a1f42f2eb9 2014-06-15 07:45:53,049 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool39-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/.tmp/b09985ace4e24213a61dc3a1f42f2eb9 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/info/b09985ace4e24213a61dc3a1f42f2eb9 2014-06-15 07:45:53,059 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool39-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/info/b09985ace4e24213a61dc3a1f42f2eb9, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:45:53,060 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool39-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. in 78ms, sequenceid=16, compaction requested=false 2014-06-15 07:45:53,060 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool39-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:53,060 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:53,061 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:53,061 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,061 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:53,061 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:53,063 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,063 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,063 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,063 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,064 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,064 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:53,064 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:53,064 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,064 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:53,064 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:53,064 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,065 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,065 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,066 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,066 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:53,067 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:53,067 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' on coordinator 2014-06-15 07:45:53,067 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1432acf[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:53,067 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:45:53,067 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,069 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,069 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,069 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,069 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,070 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,070 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,070 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,069 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,070 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:53,070 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,070 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:53,070 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:53,071 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:53,071 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:53,071 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:53,070 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:53,071 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:53,071 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:53,071 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,070 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,072 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:53,072 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:53,072 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:53,074 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:53,074 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:53,074 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:53,075 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:53,075 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:53,075 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:53,075 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:53,075 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,075 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:53,075 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:53,076 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,076 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,077 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,077 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:53,078 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:53,079 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,079 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,079 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,080 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,081 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:53,081 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,081 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:53,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:53,082 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:53,082 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,083 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,083 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:53,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:53,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,085 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,085 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,085 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,086 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:53,086 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:45:53,086 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' execution completed 2014-06-15 07:45:53,086 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:53,086 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:53,087 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,087 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteColumnsWithMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:53,093 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,093 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,093 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,093 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,093 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,093 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,093 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,093 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,094 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,101 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:53,101 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' 2014-06-15 07:45:53,102 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:53,102 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteColumnsWithMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:53,103 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:53,203 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:53,205 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:53,205 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,216 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:53,217 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,220 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:53,220 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:53,222 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002d connected 2014-06-15 07:45:53,234 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:53,234 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,236 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:53,237 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:53,238 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002e connected 2014-06-15 07:45:53,243 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,248 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:53,252 DEBUG [RpcServer.handler=3,port=45812] procedure.ProcedureCoordinator(158): Procedure testVisibilityLabelsWithDeleteColumnsWithMultipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:53,253 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' 2014-06-15 07:45:53,253 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:53,253 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' 2014-06-15 07:45:53,253 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:45:53,254 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,254 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,255 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,256 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,256 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,256 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,256 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,256 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,256 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,256 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,256 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,257 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,257 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,257 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,257 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,257 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:53,258 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,258 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,258 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,258 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,258 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:53,259 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,259 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:53,259 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:53,259 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,259 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,259 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,259 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,259 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,260 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnsWithMultipleVersions is still present, removing 2014-06-15 07:45:53,260 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnsWithMultipleVersions is still present, removing 2014-06-15 07:45:53,260 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnsWithMultipleVersions is still present, removing 2014-06-15 07:45:53,260 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,260 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,260 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:53,260 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:53,260 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:53,261 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:53,261 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:53,261 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:53,261 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:53,261 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:53,261 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:53,262 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:53,260 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,262 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:45:53,262 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:53,262 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:45:53,262 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:53,262 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:53,263 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool44-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:53,263 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,263 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool44-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. started... 2014-06-15 07:45:53,264 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool44-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082., current region memstore size 144 B 2014-06-15 07:45:53,264 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,264 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,264 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:53,265 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,265 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:53,283 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:53,284 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741859_1035 size 4951 2014-06-15 07:45:53,286 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool44-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/.tmp/6283f0ae91ae4a78abd54660c5afe9bd 2014-06-15 07:45:53,297 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool44-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/.tmp/6283f0ae91ae4a78abd54660c5afe9bd as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/info/6283f0ae91ae4a78abd54660c5afe9bd 2014-06-15 07:45:53,308 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool44-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/c383f1ec26fbb6b0da672c6525cbb082/info/6283f0ae91ae4a78abd54660c5afe9bd, entries=1, sequenceid=19, filesize=4.8 K 2014-06-15 07:45:53,309 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool44-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. in 45ms, sequenceid=19, compaction requested=true 2014-06-15 07:45:53,309 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool44-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:45:53,309 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:53,310 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:53,310 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,310 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally acquired 2014-06-15 07:45:53,310 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnsWithMultipleVersions) in zk 2014-06-15 07:45:53,313 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,313 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,313 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,313 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,313 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,313 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:53,313 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:53,313 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,314 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:53,314 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:53,315 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,315 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,316 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,316 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,316 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:53,317 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:53,317 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' on coordinator 2014-06-15 07:45:53,317 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1105002[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:53,317 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:45:53,318 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,342 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,342 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,342 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,342 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,342 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,343 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:53,342 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,343 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:53,343 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,343 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:53,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,343 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:53,344 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:53,344 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:53,344 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:45:53,344 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:53,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:53,344 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' locally completed 2014-06-15 07:45:53,345 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:53,346 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:53,346 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:53,346 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:53,346 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:53,347 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:53,347 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:53,347 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:53,347 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:45:53,347 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,347 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:53,348 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' completed. 2014-06-15 07:45:53,348 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,348 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,349 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,349 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:53,350 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:53,350 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,350 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,351 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,351 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,352 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:53,352 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,352 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,352 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,352 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,352 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:53,352 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:53,353 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:53,353 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,354 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,354 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,354 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,355 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:53,355 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:53,355 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,356 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:53,356 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:53,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:53,357 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:45:53,357 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' execution completed 2014-06-15 07:45:53,357 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:53,358 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:53,358 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteColumnsWithMultipleVersions 2014-06-15 07:45:53,358 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteColumnsWithMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:53,364 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,364 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,364 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,364 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,364 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,365 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,364 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,365 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,365 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,370 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:53,370 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteColumnsWithMultipleVersions' 2014-06-15 07:45:53,370 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:53,371 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteColumnsWithMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:53,371 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:53,471 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:53,472 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:53,473 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,507 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteColumnsWithMultipleVersions Thread=374 (was 371) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:35633 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:39594 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:39543 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: RS_OPEN_REGION-asf008:57332-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:35449 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=556 (was 553) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=616 (was 616), ProcessCount=176 (was 176), AvailableMemoryMB=2904 (was 2945), ConnectionCount=8 (was 8) 2014-06-15 07:45:53,527 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice Thread=374, OpenFileDescriptor=558, MaxFileDescriptor=60000, SystemLoadAverage=616, ProcessCount=176, AvailableMemoryMB=2904, ConnectionCount=8 2014-06-15 07:45:53,549 DEBUG [RpcServer.handler=4,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:53,552 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:53,554 INFO [RpcServer.handler=3,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:53,560 DEBUG [RpcServer.handler=3,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/write-master:458120000000000 2014-06-15 07:45:53,564 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,586 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:53,588 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741860_1036 size 341 2014-06-15 07:45:53,597 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:53,599 INFO [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(4277): creating HRegion testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice HTD == 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,615 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:53,615 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:53,619 DEBUG [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(646): Instantiated testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:53,619 DEBUG [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(1116): Closing testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00.: disabling compactions & flushes 2014-06-15 07:45:53,619 DEBUG [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:53,619 INFO [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(1225): Closed testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:53,627 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:53,628 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,628 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 61a86c307c0fd14fc27dca26fca7cf00 with OFFLINE state 2014-06-15 07:45:53,629 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:53,629 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={61a86c307c0fd14fc27dca26fca7cf00 state=OFFLINE, ts=1402818353627, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,630 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={61a86c307c0fd14fc27dca26fca7cf00 state=OFFLINE, ts=1402818353627, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,633 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:53,633 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {61a86c307c0fd14fc27dca26fca7cf00 state=OFFLINE, ts=1402818353628, server=null} to {61a86c307c0fd14fc27dca26fca7cf00 state=PENDING_OPEN, ts=1402818353633, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:53,634 INFO [Priority.RpcServer.handler=3,port=57332] regionserver.RSRpcServices(1230): Open testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:53,641 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,641 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 61a86c307c0fd14fc27dca26fca7cf00 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:53,641 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice state from ENABLING to ENABLED 2014-06-15 07:45:53,642 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/61a86c307c0fd14fc27dca26fca7cf00 2014-06-15 07:45:53,642 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 61a86c307c0fd14fc27dca26fca7cf00 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:53,643 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(4462): Opening region: {ENCODED => 61a86c307c0fd14fc27dca26fca7cf00, NAME => 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:53,643 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. service=VisibilityLabelsService 2014-06-15 07:45:53,643 INFO [RS_OPEN_REGION-asf008:57332-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:53,644 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 61a86c307c0fd14fc27dca26fca7cf00 2014-06-15 07:45:53,644 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(646): Instantiated testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:53,662 INFO [StoreOpener-61a86c307c0fd14fc27dca26fca7cf00-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:53,663 DEBUG [AM.ZK.Worker-pool3-t20] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=61a86c307c0fd14fc27dca26fca7cf00, current_state={61a86c307c0fd14fc27dca26fca7cf00 state=PENDING_OPEN, ts=1402818353633, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:53,663 INFO [AM.ZK.Worker-pool3-t20] master.RegionStates(813): Transition {61a86c307c0fd14fc27dca26fca7cf00 state=PENDING_OPEN, ts=1402818353633, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {61a86c307c0fd14fc27dca26fca7cf00 state=OPENING, ts=1402818353663, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:53,663 INFO [StoreOpener-61a86c307c0fd14fc27dca26fca7cf00-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:53,665 DEBUG [StoreOpener-61a86c307c0fd14fc27dca26fca7cf00-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/info 2014-06-15 07:45:53,666 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/write-master:458120000000000 2014-06-15 07:45:53,666 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00 2014-06-15 07:45:53,668 INFO [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(747): Onlined 61a86c307c0fd14fc27dca26fca7cf00; next sequenceid=2 2014-06-15 07:45:53,668 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 61a86c307c0fd14fc27dca26fca7cf00 2014-06-15 07:45:53,669 INFO [PostOpenDeployTasks:61a86c307c0fd14fc27dca26fca7cf00] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:53,674 INFO [PostOpenDeployTasks:61a86c307c0fd14fc27dca26fca7cf00] catalog.MetaEditor(464): Updated row testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,674 DEBUG [PostOpenDeployTasks:61a86c307c0fd14fc27dca26fca7cf00] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:53,675 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 61a86c307c0fd14fc27dca26fca7cf00 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:53,677 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 61a86c307c0fd14fc27dca26fca7cf00 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:53,677 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/61a86c307c0fd14fc27dca26fca7cf00 2014-06-15 07:45:53,677 DEBUG [RS_OPEN_REGION-asf008:57332-0] coordination.ZkOpenRegionCoordination(91): Transitioned 61a86c307c0fd14fc27dca26fca7cf00 to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,677 DEBUG [RS_OPEN_REGION-asf008:57332-0] handler.OpenRegionHandler(167): Opened testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,678 DEBUG [AM.ZK.Worker-pool3-t3] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=61a86c307c0fd14fc27dca26fca7cf00, current_state={61a86c307c0fd14fc27dca26fca7cf00 state=OPENING, ts=1402818353663, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:53,678 INFO [AM.ZK.Worker-pool3-t3] master.RegionStates(813): Transition {61a86c307c0fd14fc27dca26fca7cf00 state=OPENING, ts=1402818353663, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {61a86c307c0fd14fc27dca26fca7cf00 state=OPEN, ts=1402818353678, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:53,678 DEBUG [AM.ZK.Worker-pool3-t3] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 61a86c307c0fd14fc27dca26fca7cf00 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:53,681 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/61a86c307c0fd14fc27dca26fca7cf00 2014-06-15 07:45:53,681 DEBUG [AM.ZK.Worker-pool3-t3] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 61a86c307c0fd14fc27dca26fca7cf00 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:53,681 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:53,681 DEBUG [AM.ZK.Worker-pool3-t3] master.AssignmentManager$4(1293): Znode testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. deleted, state: {61a86c307c0fd14fc27dca26fca7cf00 state=OPEN, ts=1402818353678, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:53,682 INFO [AM.ZK.Worker-pool3-t3] master.RegionStates(359): Onlined 61a86c307c0fd14fc27dca26fca7cf00 on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,879 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:53,880 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,884 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:53,884 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:53,885 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002f connected 2014-06-15 07:45:53,890 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a002f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,913 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:53,913 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,915 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:53,915 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:53,917 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0030 connected 2014-06-15 07:45:53,929 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:53,929 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,933 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:53,933 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:53,934 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0031 connected 2014-06-15 07:45:53,938 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0031, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:53,941 INFO [RpcServer.handler=4,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:53,946 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' 2014-06-15 07:45:53,947 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:53,947 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' starting 'acquire' 2014-06-15 07:45:53,947 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice', kicking off acquire phase on members. 2014-06-15 07:45:53,947 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,948 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,949 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,950 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,950 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:53,950 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,950 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,950 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,950 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,950 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,951 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,950 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:53,951 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,951 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:53,951 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,951 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:53,951 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,951 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:53,952 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:53,952 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:53,952 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,952 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,953 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,953 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,952 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,953 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,953 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,953 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' with timeout 60000ms 2014-06-15 07:45:53,954 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' with timeout 60000ms 2014-06-15 07:45:53,954 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:53,954 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:53,954 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' starting 'acquire' stage 2014-06-15 07:45:53,954 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' starting 'acquire' stage 2014-06-15 07:45:53,954 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' locally acquired 2014-06-15 07:45:53,954 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool45-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:53,955 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool45-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. started... 2014-06-15 07:45:53,954 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,955 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool45-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00., current region memstore size 712 B 2014-06-15 07:45:53,954 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice) in zk 2014-06-15 07:45:53,954 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:53,956 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:53,956 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:53,956 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,956 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,957 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,957 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' with timeout 60000ms 2014-06-15 07:45:53,957 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:53,957 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' starting 'acquire' stage 2014-06-15 07:45:53,957 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' locally acquired 2014-06-15 07:45:53,957 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice) in zk 2014-06-15 07:45:53,959 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,960 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,960 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:53,962 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,962 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:53,962 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:53,979 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:53,980 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:54,006 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool45-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/.tmp/627299f8034d42b88699f4250183b4c6 2014-06-15 07:45:54,016 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool45-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/.tmp/627299f8034d42b88699f4250183b4c6 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/info/627299f8034d42b88699f4250183b4c6 2014-06-15 07:45:54,029 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool45-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/info/627299f8034d42b88699f4250183b4c6, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:45:54,029 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool45-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. in 74ms, sequenceid=13, compaction requested=false 2014-06-15 07:45:54,029 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool45-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:45:54,029 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:54,030 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:54,030 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,030 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' locally acquired 2014-06-15 07:45:54,030 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice) in zk 2014-06-15 07:45:54,033 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,033 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,033 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,033 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,033 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:54,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:54,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:54,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:54,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:54,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:54,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:54,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:54,037 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' on coordinator 2014-06-15 07:45:54,038 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@19bc401[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:54,038 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' starting 'in-barrier' execution. 2014-06-15 07:45:54,038 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,041 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,041 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,041 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,041 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,041 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,041 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,042 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' received 'reached' from coordinator. 2014-06-15 07:45:54,042 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,042 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' locally completed 2014-06-15 07:45:54,042 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,041 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,042 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:54,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,042 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' received 'reached' from coordinator. 2014-06-15 07:45:54,043 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' received 'reached' from coordinator. 2014-06-15 07:45:54,043 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' locally completed 2014-06-15 07:45:54,043 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:54,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,043 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' locally completed 2014-06-15 07:45:54,044 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:54,044 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:54,044 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:54,046 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' has notified controller of completion 2014-06-15 07:45:54,047 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:54,047 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' has notified controller of completion 2014-06-15 07:45:54,047 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' completed. 2014-06-15 07:45:54,047 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:54,047 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' completed. 2014-06-15 07:45:54,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:54,048 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' has notified controller of completion 2014-06-15 07:45:54,048 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,048 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:54,048 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' completed. 2014-06-15 07:45:54,048 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:54,049 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,049 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:54,049 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:54,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:54,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:54,051 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,051 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:54,052 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:54,052 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,052 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:54,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:54,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:54,053 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,053 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:54,053 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,054 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:54,054 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:54,054 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:54,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:54,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,056 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:54,058 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:54,058 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice', counting down latch. Waiting for 0 more 2014-06-15 07:45:54,058 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' execution completed 2014-06-15 07:45:54,058 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:54,058 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:54,058 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:45:54,058 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwiceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:54,248 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:54,248 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:54,249 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:54,249 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:54,249 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:54,249 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:54,248 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:54,250 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:54,250 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:54,279 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:54,280 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice' 2014-06-15 07:45:54,280 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:54,280 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:54,281 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:54,381 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:54,384 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:54,384 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0030, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:54,471 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice Thread=375 (was 374) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1952120439_8 at /127.0.0.1:39638 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:35449 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=562 (was 558) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=583 (was 616), ProcessCount=176 (was 176), AvailableMemoryMB=2869 (was 2904), ConnectionCount=8 (was 8) 2014-06-15 07:45:54,495 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteFamilyVersion Thread=376, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=583, ProcessCount=176, AvailableMemoryMB=2868, ConnectionCount=8 2014-06-15 07:45:54,558 DEBUG [RpcServer.handler=1,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:54,560 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:54,563 INFO [RpcServer.handler=4,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testVisibilityLabelsWithDeleteFamilyVersion', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:54,568 DEBUG [RpcServer.handler=4,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testVisibilityLabelsWithDeleteFamilyVersion/write-master:458120000000000 2014-06-15 07:45:54,571 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,589 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:54,593 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:54,630 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testVisibilityLabelsWithDeleteFamilyVersion/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:54,632 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamilyVersion-1] regionserver.HRegion(4277): creating HRegion testVisibilityLabelsWithDeleteFamilyVersion HTD == 'testVisibilityLabelsWithDeleteFamilyVersion', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,650 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:54,651 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741864_1040 size 76 2014-06-15 07:45:54,653 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamilyVersion-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,653 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamilyVersion-1] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b.: disabling compactions & flushes 2014-06-15 07:45:54,653 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamilyVersion-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,653 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamilyVersion-1] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,659 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:54,659 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,660 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 5dc3da97048cab44677aa991904a9c5b with OFFLINE state 2014-06-15 07:45:54,661 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:54,661 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={5dc3da97048cab44677aa991904a9c5b state=OFFLINE, ts=1402818354659, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,662 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={5dc3da97048cab44677aa991904a9c5b state=OFFLINE, ts=1402818354659, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,665 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:54,665 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {5dc3da97048cab44677aa991904a9c5b state=OFFLINE, ts=1402818354660, server=null} to {5dc3da97048cab44677aa991904a9c5b state=PENDING_OPEN, ts=1402818354665, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:54,666 INFO [Priority.RpcServer.handler=5,port=57332] regionserver.RSRpcServices(1230): Open testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,673 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 5dc3da97048cab44677aa991904a9c5b from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:54,673 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,673 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testVisibilityLabelsWithDeleteFamilyVersion state from ENABLING to ENABLED 2014-06-15 07:45:54,675 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5dc3da97048cab44677aa991904a9c5b 2014-06-15 07:45:54,675 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 5dc3da97048cab44677aa991904a9c5b from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:54,675 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(4462): Opening region: {ENCODED => 5dc3da97048cab44677aa991904a9c5b, NAME => 'testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:54,676 DEBUG [AM.ZK.Worker-pool3-t5] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=5dc3da97048cab44677aa991904a9c5b, current_state={5dc3da97048cab44677aa991904a9c5b state=PENDING_OPEN, ts=1402818354665, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:54,676 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(5559): Registered coprocessor service: region=testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. service=VisibilityLabelsService 2014-06-15 07:45:54,676 INFO [RS_OPEN_REGION-asf008:57332-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:54,676 INFO [AM.ZK.Worker-pool3-t5] master.RegionStates(813): Transition {5dc3da97048cab44677aa991904a9c5b state=PENDING_OPEN, ts=1402818354665, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {5dc3da97048cab44677aa991904a9c5b state=OPENING, ts=1402818354676, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:54,676 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testVisibilityLabelsWithDeleteFamilyVersion 5dc3da97048cab44677aa991904a9c5b 2014-06-15 07:45:54,677 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,678 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testVisibilityLabelsWithDeleteFamilyVersion/write-master:458120000000000 2014-06-15 07:45:54,684 INFO [StoreOpener-5dc3da97048cab44677aa991904a9c5b-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:54,685 INFO [StoreOpener-5dc3da97048cab44677aa991904a9c5b-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:54,686 DEBUG [StoreOpener-5dc3da97048cab44677aa991904a9c5b-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/info 2014-06-15 07:45:54,687 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b 2014-06-15 07:45:54,689 INFO [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(747): Onlined 5dc3da97048cab44677aa991904a9c5b; next sequenceid=2 2014-06-15 07:45:54,689 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 5dc3da97048cab44677aa991904a9c5b 2014-06-15 07:45:54,690 INFO [PostOpenDeployTasks:5dc3da97048cab44677aa991904a9c5b] regionserver.HRegionServer(1663): Post open deploy tasks for testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,693 INFO [PostOpenDeployTasks:5dc3da97048cab44677aa991904a9c5b] catalog.MetaEditor(464): Updated row testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,693 DEBUG [PostOpenDeployTasks:5dc3da97048cab44677aa991904a9c5b] regionserver.HRegionServer(1693): Finished post open deploy task for testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,694 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 5dc3da97048cab44677aa991904a9c5b from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:54,695 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/5dc3da97048cab44677aa991904a9c5b 2014-06-15 07:45:54,695 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 5dc3da97048cab44677aa991904a9c5b from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:54,695 DEBUG [RS_OPEN_REGION-asf008:57332-1] coordination.ZkOpenRegionCoordination(91): Transitioned 5dc3da97048cab44677aa991904a9c5b to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,696 DEBUG [RS_OPEN_REGION-asf008:57332-1] handler.OpenRegionHandler(167): Opened testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,696 DEBUG [AM.ZK.Worker-pool3-t6] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=5dc3da97048cab44677aa991904a9c5b, current_state={5dc3da97048cab44677aa991904a9c5b state=OPENING, ts=1402818354676, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:54,696 INFO [AM.ZK.Worker-pool3-t6] master.RegionStates(813): Transition {5dc3da97048cab44677aa991904a9c5b state=OPENING, ts=1402818354676, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {5dc3da97048cab44677aa991904a9c5b state=OPEN, ts=1402818354696, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:54,696 DEBUG [AM.ZK.Worker-pool3-t6] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 5dc3da97048cab44677aa991904a9c5b from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:54,698 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/5dc3da97048cab44677aa991904a9c5b 2014-06-15 07:45:54,698 DEBUG [AM.ZK.Worker-pool3-t6] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 5dc3da97048cab44677aa991904a9c5b in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:54,698 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:54,698 DEBUG [AM.ZK.Worker-pool3-t6] master.AssignmentManager$4(1293): Znode testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. deleted, state: {5dc3da97048cab44677aa991904a9c5b state=OPEN, ts=1402818354696, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:54,698 INFO [AM.ZK.Worker-pool3-t6] master.RegionStates(359): Onlined 5dc3da97048cab44677aa991904a9c5b on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,884 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:54,884 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:54,886 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:54,886 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:54,887 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0032 connected 2014-06-15 07:45:54,890 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0032, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:54,895 INFO [pool-1-thread-1] hbase.Waiter(174): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2014-06-15 07:45:54,910 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:54,911 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:54,914 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:54,914 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:54,915 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0033 connected 2014-06-15 07:45:54,927 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:54,927 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:54,930 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:54,930 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:54,931 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0034 connected 2014-06-15 07:45:54,934 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0034, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:54,936 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:54,941 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteFamilyVersion' 2014-06-15 07:45:54,941 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:54,941 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' 2014-06-15 07:45:54,941 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteFamilyVersion', kicking off acquire phase on members. 2014-06-15 07:45:54,941 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,941 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,943 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:54,943 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:54,944 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:54,944 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:54,944 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:54,944 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:54,944 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,943 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:54,944 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:54,944 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:54,945 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,945 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,945 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,945 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:54,945 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,945 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,945 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,946 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,946 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:54,946 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:54,946 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,946 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,946 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,946 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,946 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:54,947 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,947 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,947 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,947 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,947 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:54,947 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,947 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:54,947 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:54,947 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:54,948 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:54,947 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:54,948 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool49-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,948 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:54,948 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool49-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. started... 2014-06-15 07:45:54,948 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:54,948 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:54,948 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:54,949 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:54,949 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:54,949 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:54,949 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool49-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b., current region memstore size 144 B 2014-06-15 07:45:54,948 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:54,950 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:54,952 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,952 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,952 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,953 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:54,953 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,953 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:54,970 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:54,970 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:54,972 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool49-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=5, memsize=144, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/.tmp/7d7479141d174855b09f24b73582fd60 2014-06-15 07:45:54,982 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool49-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/.tmp/7d7479141d174855b09f24b73582fd60 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/info/7d7479141d174855b09f24b73582fd60 2014-06-15 07:45:54,991 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool49-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/info/7d7479141d174855b09f24b73582fd60, entries=1, sequenceid=5, filesize=4.6 K 2014-06-15 07:45:54,991 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool49-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. in 42ms, sequenceid=5, compaction requested=false 2014-06-15 07:45:54,991 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool49-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:54,991 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:54,991 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:54,991 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,991 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:54,991 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:54,994 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,994 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,994 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:54,995 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:54,995 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:54,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:54,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:54,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:54,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:54,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:54,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:54,998 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:54,998 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteFamilyVersion' on coordinator 2014-06-15 07:45:54,998 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1da9eda[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:54,998 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'in-barrier' execution. 2014-06-15 07:45:54,998 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,000 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,000 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,000 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,000 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,000 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,000 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,000 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,000 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,000 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,001 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,001 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,001 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,001 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:55,001 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,001 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:55,001 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,001 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:55,002 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,001 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,002 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:55,002 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,002 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:55,003 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,003 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:55,003 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,004 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,005 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,005 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,005 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,005 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,045 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,045 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,045 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,046 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,046 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,046 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:55,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:55,048 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,048 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,049 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,049 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,050 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteFamilyVersion' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:55,050 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,050 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:55,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:55,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:55,051 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,051 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:55,053 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:55,054 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,054 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,054 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteFamilyVersion' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:55,055 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteFamilyVersion', counting down latch. Waiting for 0 more 2014-06-15 07:45:55,055 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' execution completed 2014-06-15 07:45:55,056 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:55,056 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:55,056 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,056 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteFamilyVersionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:55,067 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,067 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,067 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,067 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,067 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,067 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,067 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,068 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,068 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,077 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,077 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteFamilyVersion' 2014-06-15 07:45:55,078 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:55,078 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteFamilyVersion'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:55,078 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:55,179 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:55,180 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:55,181 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0033, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,191 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:55,191 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,193 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:55,194 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:55,194 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0035 connected 2014-06-15 07:45:55,205 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:55,205 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,208 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:55,208 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:55,209 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0036 connected 2014-06-15 07:45:55,212 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0036, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,215 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:55,220 DEBUG [RpcServer.handler=3,port=45812] procedure.ProcedureCoordinator(158): Procedure testVisibilityLabelsWithDeleteFamilyVersion was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:55,221 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteFamilyVersion' 2014-06-15 07:45:55,221 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:55,221 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' 2014-06-15 07:45:55,221 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteFamilyVersion', kicking off acquire phase on members. 2014-06-15 07:45:55,222 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,222 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,224 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,224 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,224 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,224 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,224 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,224 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,224 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,225 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,225 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,225 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,225 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:55,225 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,225 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,226 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,226 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,226 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,226 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:55,226 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,227 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,227 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,227 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,227 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteFamilyVersion is still present, removing 2014-06-15 07:45:55,227 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,227 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:55,227 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:55,227 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,228 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:55,228 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,228 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:55,227 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:55,228 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:55,228 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,228 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteFamilyVersion is still present, removing 2014-06-15 07:45:55,229 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,229 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,228 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:55,229 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:55,229 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteFamilyVersion is still present, removing 2014-06-15 07:45:55,229 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:55,229 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,229 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:55,230 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:55,230 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:55,230 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:55,230 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:55,230 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:55,231 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:55,231 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:55,231 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool53-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:55,231 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool53-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. started... 2014-06-15 07:45:55,231 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,231 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool53-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b., current region memstore size 136 B 2014-06-15 07:45:55,232 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,232 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,232 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:55,233 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,233 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:55,247 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:55,247 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:55,249 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool53-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=8, memsize=136, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/.tmp/677fd3f32c60412e83eb731e5b23428c 2014-06-15 07:45:55,260 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool53-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/.tmp/677fd3f32c60412e83eb731e5b23428c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/info/677fd3f32c60412e83eb731e5b23428c 2014-06-15 07:45:55,268 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool53-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/info/677fd3f32c60412e83eb731e5b23428c, entries=1, sequenceid=8, filesize=4.6 K 2014-06-15 07:45:55,269 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool53-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. in 38ms, sequenceid=8, compaction requested=false 2014-06-15 07:45:55,269 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool53-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:55,269 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:55,269 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:55,269 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,269 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:55,269 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:55,271 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,271 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,271 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,271 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,271 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,271 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,272 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:55,272 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:55,272 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:55,275 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:55,275 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,275 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,276 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,276 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,276 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:55,277 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:55,277 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteFamilyVersion' on coordinator 2014-06-15 07:45:55,277 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@4523d6[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:55,277 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'in-barrier' execution. 2014-06-15 07:45:55,277 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,280 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,280 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,280 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,280 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,280 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,280 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,280 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,281 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,281 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,281 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,281 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,281 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:55,281 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,280 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,281 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,282 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,282 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,282 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:55,282 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,282 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:55,282 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:55,281 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:55,283 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,283 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:55,283 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,284 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,286 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,286 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,286 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,286 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,286 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,286 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,287 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,287 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,287 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,288 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,288 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:55,288 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:55,289 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,289 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,290 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,290 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,291 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteFamilyVersion' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:55,291 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,291 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:55,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:55,292 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:55,292 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,294 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:55,294 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:55,294 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,295 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,295 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,296 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,296 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteFamilyVersion' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:55,296 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteFamilyVersion', counting down latch. Waiting for 0 more 2014-06-15 07:45:55,296 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' execution completed 2014-06-15 07:45:55,297 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:55,297 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:55,297 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,297 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteFamilyVersionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:55,302 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,302 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,302 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,302 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,302 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,303 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,303 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,303 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,303 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,324 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,324 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteFamilyVersion' 2014-06-15 07:45:55,324 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:55,325 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteFamilyVersion'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:55,325 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:55,425 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:55,426 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:55,427 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0035, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,437 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:55,438 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,440 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:55,440 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:55,441 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0037 connected 2014-06-15 07:45:55,455 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:55,456 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,458 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:55,458 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:55,459 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0038 connected 2014-06-15 07:45:55,470 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0038, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,475 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:55,479 DEBUG [RpcServer.handler=1,port=45812] procedure.ProcedureCoordinator(158): Procedure testVisibilityLabelsWithDeleteFamilyVersion was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:55,479 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteFamilyVersion' 2014-06-15 07:45:55,479 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:55,479 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' 2014-06-15 07:45:55,479 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteFamilyVersion', kicking off acquire phase on members. 2014-06-15 07:45:55,480 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,480 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,483 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,483 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,483 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,483 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,484 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,484 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,484 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,484 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:55,483 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,484 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,484 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,484 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,485 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,485 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,486 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,486 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,486 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,487 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:55,487 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,487 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,487 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,487 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:55,488 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,488 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteFamilyVersion is still present, removing 2014-06-15 07:45:55,488 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,488 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:55,488 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,488 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:55,488 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:55,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,489 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteFamilyVersion is still present, removing 2014-06-15 07:45:55,489 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,489 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,488 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:55,489 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteFamilyVersion is still present, removing 2014-06-15 07:45:55,489 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:55,489 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:55,489 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:55,490 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:55,490 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:55,490 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:55,490 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:55,490 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. started... 2014-06-15 07:45:55,490 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:55,490 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b., current region memstore size 136 B 2014-06-15 07:45:55,489 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,491 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' with timeout 60000ms 2014-06-15 07:45:55,491 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:55,491 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'acquire' stage 2014-06-15 07:45:55,492 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:55,492 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:55,495 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,498 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,498 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,499 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:55,499 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,499 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:55,509 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:55,510 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:55,512 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=11, memsize=136, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/.tmp/757d2e284ddd4d13a0c7c2e79ddecfcc 2014-06-15 07:45:55,521 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 757d2e284ddd4d13a0c7c2e79ddecfcc 2014-06-15 07:45:55,523 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/.tmp/757d2e284ddd4d13a0c7c2e79ddecfcc as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/info/757d2e284ddd4d13a0c7c2e79ddecfcc 2014-06-15 07:45:55,533 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 757d2e284ddd4d13a0c7c2e79ddecfcc 2014-06-15 07:45:55,533 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamilyVersion/5dc3da97048cab44677aa991904a9c5b/info/757d2e284ddd4d13a0c7c2e79ddecfcc, entries=1, sequenceid=11, filesize=4.8 K 2014-06-15 07:45:55,534 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. in 44ms, sequenceid=11, compaction requested=true 2014-06-15 07:45:55,534 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool54-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:45:55,534 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:55,534 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:55,534 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,534 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally acquired 2014-06-15 07:45:55,534 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamilyVersion) in zk 2014-06-15 07:45:55,536 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,536 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,536 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,537 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,537 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,537 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:55,537 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:55,537 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,537 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:55,537 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:55,538 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,538 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,538 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,539 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,539 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:55,539 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:55,540 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteFamilyVersion' on coordinator 2014-06-15 07:45:55,540 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@b14efc[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:55,540 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' starting 'in-barrier' execution. 2014-06-15 07:45:55,540 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,541 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,541 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,542 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,541 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,542 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,542 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,542 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,542 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,542 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,542 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,542 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,543 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,542 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,543 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:55,543 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:55,543 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:55,542 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,543 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,543 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' received 'reached' from coordinator. 2014-06-15 07:45:55,543 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:55,544 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:55,543 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' locally completed 2014-06-15 07:45:55,544 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:55,544 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,546 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,546 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,546 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,546 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,547 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,547 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,547 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' has notified controller of completion 2014-06-15 07:45:55,547 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,547 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,547 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,547 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamilyVersion' completed. 2014-06-15 07:45:55,547 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,548 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:55,548 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:55,549 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,549 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,549 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,550 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,550 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteFamilyVersion' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:55,550 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,550 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,550 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,550 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamilyVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:55,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:55,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:55,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,552 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,552 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,552 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,553 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:55,553 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:55,553 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,554 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:55,554 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:55,555 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,556 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteFamilyVersion' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:55,556 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteFamilyVersion', counting down latch. Waiting for 0 more 2014-06-15 07:45:55,556 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteFamilyVersion' execution completed 2014-06-15 07:45:55,556 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:55,556 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:55,556 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteFamilyVersion 2014-06-15 07:45:55,557 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteFamilyVersionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:55,562 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,563 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,563 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,563 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,563 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:55,563 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,564 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:55,564 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,564 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:55,570 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:55,570 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteFamilyVersion' 2014-06-15 07:45:55,570 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:55,571 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteFamilyVersion'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:55,571 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:55,671 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:55,672 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:55,673 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0037, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:55,706 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteFamilyVersion Thread=376 (was 376), OpenFileDescriptor=565 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=583 (was 583), ProcessCount=176 (was 176), AvailableMemoryMB=3085 (was 2868) - AvailableMemoryMB LEAK? -, ConnectionCount=8 (was 8) 2014-06-15 07:45:55,729 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testSpecificDeletesFollowedByDeleteFamily1 Thread=376, OpenFileDescriptor=567, MaxFileDescriptor=60000, SystemLoadAverage=583, ProcessCount=176, AvailableMemoryMB=3083, ConnectionCount=8 2014-06-15 07:45:55,794 DEBUG [RpcServer.handler=0,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:55,798 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:55,802 INFO [RpcServer.handler=1,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testSpecificDeletesFollowedByDeleteFamily1', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:55,846 DEBUG [RpcServer.handler=1,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testSpecificDeletesFollowedByDeleteFamily1/write-master:458120000000000 2014-06-15 07:45:55,857 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:55,881 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:55,882 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741868_1044 size 322 2014-06-15 07:45:55,900 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testSpecificDeletesFollowedByDeleteFamily1/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:55,902 INFO [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily1-1] regionserver.HRegion(4277): creating HRegion testSpecificDeletesFollowedByDeleteFamily1 HTD == 'testSpecificDeletesFollowedByDeleteFamily1', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:55,927 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:55,927 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:55,933 DEBUG [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily1-1] regionserver.HRegion(646): Instantiated testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:55,933 DEBUG [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily1-1] regionserver.HRegion(1116): Closing testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2.: disabling compactions & flushes 2014-06-15 07:45:55,933 DEBUG [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily1-1] regionserver.HRegion(1143): Updates disabled for region testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:55,934 INFO [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily1-1] regionserver.HRegion(1225): Closed testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:55,941 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:55,941 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,941 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node f34d49a7897834339b9c66919f2c1ab2 with OFFLINE state 2014-06-15 07:45:55,943 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:55,943 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={f34d49a7897834339b9c66919f2c1ab2 state=OFFLINE, ts=1402818355941, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,945 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={f34d49a7897834339b9c66919f2c1ab2 state=OFFLINE, ts=1402818355941, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,947 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:55,947 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {f34d49a7897834339b9c66919f2c1ab2 state=OFFLINE, ts=1402818355941, server=null} to {f34d49a7897834339b9c66919f2c1ab2 state=PENDING_OPEN, ts=1402818355947, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:55,948 INFO [Priority.RpcServer.handler=6,port=57332] regionserver.RSRpcServices(1230): Open testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:55,954 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning f34d49a7897834339b9c66919f2c1ab2 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:55,955 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,955 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testSpecificDeletesFollowedByDeleteFamily1 state from ENABLING to ENABLED 2014-06-15 07:45:55,959 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node f34d49a7897834339b9c66919f2c1ab2 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:55,959 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f34d49a7897834339b9c66919f2c1ab2 2014-06-15 07:45:55,960 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(4462): Opening region: {ENCODED => f34d49a7897834339b9c66919f2c1ab2, NAME => 'testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:55,960 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(5559): Registered coprocessor service: region=testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. service=VisibilityLabelsService 2014-06-15 07:45:55,960 INFO [RS_OPEN_REGION-asf008:57332-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:55,961 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testSpecificDeletesFollowedByDeleteFamily1 f34d49a7897834339b9c66919f2c1ab2 2014-06-15 07:45:55,961 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(646): Instantiated testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:55,962 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testSpecificDeletesFollowedByDeleteFamily1/write-master:458120000000000 2014-06-15 07:45:55,962 DEBUG [AM.ZK.Worker-pool3-t10] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=f34d49a7897834339b9c66919f2c1ab2, current_state={f34d49a7897834339b9c66919f2c1ab2 state=PENDING_OPEN, ts=1402818355947, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:55,962 INFO [AM.ZK.Worker-pool3-t10] master.RegionStates(813): Transition {f34d49a7897834339b9c66919f2c1ab2 state=PENDING_OPEN, ts=1402818355947, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {f34d49a7897834339b9c66919f2c1ab2 state=OPENING, ts=1402818355962, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:55,967 INFO [StoreOpener-f34d49a7897834339b9c66919f2c1ab2-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:55,968 INFO [StoreOpener-f34d49a7897834339b9c66919f2c1ab2-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:55,970 DEBUG [StoreOpener-f34d49a7897834339b9c66919f2c1ab2-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/info 2014-06-15 07:45:55,971 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2 2014-06-15 07:45:55,973 INFO [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(747): Onlined f34d49a7897834339b9c66919f2c1ab2; next sequenceid=2 2014-06-15 07:45:55,973 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node f34d49a7897834339b9c66919f2c1ab2 2014-06-15 07:45:55,974 INFO [PostOpenDeployTasks:f34d49a7897834339b9c66919f2c1ab2] regionserver.HRegionServer(1663): Post open deploy tasks for testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:55,980 INFO [PostOpenDeployTasks:f34d49a7897834339b9c66919f2c1ab2] catalog.MetaEditor(464): Updated row testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,980 DEBUG [PostOpenDeployTasks:f34d49a7897834339b9c66919f2c1ab2] regionserver.HRegionServer(1693): Finished post open deploy task for testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:55,982 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning f34d49a7897834339b9c66919f2c1ab2 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:55,986 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f34d49a7897834339b9c66919f2c1ab2 2014-06-15 07:45:55,986 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node f34d49a7897834339b9c66919f2c1ab2 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:55,986 DEBUG [RS_OPEN_REGION-asf008:57332-2] coordination.ZkOpenRegionCoordination(91): Transitioned f34d49a7897834339b9c66919f2c1ab2 to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,986 DEBUG [RS_OPEN_REGION-asf008:57332-2] handler.OpenRegionHandler(167): Opened testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:55,987 DEBUG [AM.ZK.Worker-pool3-t13] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=f34d49a7897834339b9c66919f2c1ab2, current_state={f34d49a7897834339b9c66919f2c1ab2 state=OPENING, ts=1402818355962, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:55,987 INFO [AM.ZK.Worker-pool3-t13] master.RegionStates(813): Transition {f34d49a7897834339b9c66919f2c1ab2 state=OPENING, ts=1402818355962, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {f34d49a7897834339b9c66919f2c1ab2 state=OPEN, ts=1402818355987, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:55,987 DEBUG [AM.ZK.Worker-pool3-t13] coordination.ZkOpenRegionCoordination(350): Handling OPENED of f34d49a7897834339b9c66919f2c1ab2 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:55,989 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/f34d49a7897834339b9c66919f2c1ab2 2014-06-15 07:45:55,989 DEBUG [AM.ZK.Worker-pool3-t13] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node f34d49a7897834339b9c66919f2c1ab2 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:55,989 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:55,989 DEBUG [AM.ZK.Worker-pool3-t13] master.AssignmentManager$4(1293): Znode testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. deleted, state: {f34d49a7897834339b9c66919f2c1ab2 state=OPEN, ts=1402818355987, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:55,990 INFO [AM.ZK.Worker-pool3-t13] master.RegionStates(359): Onlined f34d49a7897834339b9c66919f2c1ab2 on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,176 INFO [Thread-548] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:56,176 DEBUG [Thread-548] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,179 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:56,180 DEBUG [Thread-548] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:56,181 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0039 connected 2014-06-15 07:45:56,185 DEBUG [Thread-548] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0039, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,205 INFO [Thread-548] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:56,205 DEBUG [Thread-548] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,208 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:56,208 DEBUG [Thread-548] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:56,209 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003a connected 2014-06-15 07:45:56,218 INFO [Thread-548] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:56,218 DEBUG [Thread-548] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,220 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:56,220 DEBUG [Thread-548] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:56,221 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003b connected 2014-06-15 07:45:56,224 DEBUG [Thread-548] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,226 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:56,230 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testSpecificDeletesFollowedByDeleteFamily1' 2014-06-15 07:45:56,231 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:56,231 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'acquire' 2014-06-15 07:45:56,231 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testSpecificDeletesFollowedByDeleteFamily1', kicking off acquire phase on members. 2014-06-15 07:45:56,231 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,231 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,232 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,233 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,233 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,233 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,233 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,233 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,233 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,233 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,233 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,234 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,233 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,234 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,234 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,234 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:56,234 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,234 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,234 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:56,235 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:56,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:56,235 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,236 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,236 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,236 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,236 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,236 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' with timeout 60000ms 2014-06-15 07:45:56,236 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,236 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,236 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:56,237 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' with timeout 60000ms 2014-06-15 07:45:56,237 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'acquire' stage 2014-06-15 07:45:56,237 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:56,237 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally acquired 2014-06-15 07:45:56,237 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'acquire' stage 2014-06-15 07:45:56,237 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily1) in zk 2014-06-15 07:45:56,237 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' with timeout 60000ms 2014-06-15 07:45:56,237 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:56,238 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:56,238 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:56,238 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'acquire' stage 2014-06-15 07:45:56,238 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool59-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:56,238 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally acquired 2014-06-15 07:45:56,238 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool59-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. started... 2014-06-15 07:45:56,238 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily1) in zk 2014-06-15 07:45:56,240 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool59-thread-1] regionserver.HRegion(1696): Started memstore flush for testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2., current region memstore size 712 B 2014-06-15 07:45:56,240 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,240 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,240 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:56,241 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,242 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,242 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:56,289 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:56,289 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:45:56,292 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool59-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/.tmp/c668b7c6c2764011ae506985088adb18 2014-06-15 07:45:56,302 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool59-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/.tmp/c668b7c6c2764011ae506985088adb18 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/info/c668b7c6c2764011ae506985088adb18 2014-06-15 07:45:56,310 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool59-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/info/c668b7c6c2764011ae506985088adb18, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:45:56,311 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool59-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. in 71ms, sequenceid=13, compaction requested=false 2014-06-15 07:45:56,311 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool59-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:56,311 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:56,311 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:56,311 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,311 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally acquired 2014-06-15 07:45:56,311 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily1) in zk 2014-06-15 07:45:56,313 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,313 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,313 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,313 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,313 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,314 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:56,314 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:56,314 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,314 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:56,314 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:56,314 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,314 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,315 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,315 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,315 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:56,315 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:56,316 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testSpecificDeletesFollowedByDeleteFamily1' on coordinator 2014-06-15 07:45:56,316 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1b7eb54[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:56,316 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'in-barrier' execution. 2014-06-15 07:45:56,316 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,317 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,317 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,317 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,317 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,317 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,317 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,317 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,317 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,318 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' received 'reached' from coordinator. 2014-06-15 07:45:56,317 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,318 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally completed 2014-06-15 07:45:56,318 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' received 'reached' from coordinator. 2014-06-15 07:45:56,318 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally completed 2014-06-15 07:45:56,317 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,318 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily1' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:56,318 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily1' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:56,318 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' received 'reached' from coordinator. 2014-06-15 07:45:56,318 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,319 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally completed 2014-06-15 07:45:56,319 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily1' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:56,319 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:56,319 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:56,320 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' has notified controller of completion 2014-06-15 07:45:56,320 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:56,320 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:56,320 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' has notified controller of completion 2014-06-15 07:45:56,320 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' completed. 2014-06-15 07:45:56,321 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:56,321 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' completed. 2014-06-15 07:45:56,321 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' has notified controller of completion 2014-06-15 07:45:56,321 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,321 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:56,321 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' completed. 2014-06-15 07:45:56,321 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,322 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,322 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,322 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:56,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:56,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,324 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testSpecificDeletesFollowedByDeleteFamily1' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:56,324 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,324 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,325 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:56,325 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:56,325 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:56,325 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,325 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:56,327 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:56,327 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,327 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,327 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,328 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,328 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testSpecificDeletesFollowedByDeleteFamily1' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:56,328 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testSpecificDeletesFollowedByDeleteFamily1', counting down latch. Waiting for 0 more 2014-06-15 07:45:56,328 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testSpecificDeletesFollowedByDeleteFamily1' execution completed 2014-06-15 07:45:56,329 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:56,329 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:56,329 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,329 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testSpecificDeletesFollowedByDeleteFamily1including nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:56,352 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,352 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,352 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,352 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,352 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,352 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,352 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,352 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,353 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,359 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:56,359 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testSpecificDeletesFollowedByDeleteFamily1' 2014-06-15 07:45:56,359 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:56,359 DEBUG [Thread-548] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testSpecificDeletesFollowedByDeleteFamily1'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:56,360 DEBUG [Thread-548] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:56,460 DEBUG [Thread-548] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:56,461 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:56,461 DEBUG [Thread-548] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,484 INFO [Thread-548] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:56,484 DEBUG [Thread-548] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,486 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:56,486 DEBUG [Thread-548] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:56,487 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003c connected 2014-06-15 07:45:56,499 INFO [Thread-548] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:56,499 DEBUG [Thread-548] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,500 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:56,500 DEBUG [Thread-548] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:56,502 DEBUG [Thread-548-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003d connected 2014-06-15 07:45:56,504 DEBUG [Thread-548] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,506 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:56,510 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testSpecificDeletesFollowedByDeleteFamily1 was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:56,511 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testSpecificDeletesFollowedByDeleteFamily1' 2014-06-15 07:45:56,511 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:56,511 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'acquire' 2014-06-15 07:45:56,511 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testSpecificDeletesFollowedByDeleteFamily1', kicking off acquire phase on members. 2014-06-15 07:45:56,511 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,511 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,513 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,513 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,513 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,513 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,513 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,513 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,513 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,513 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,513 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:56,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,514 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,514 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,514 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,514 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,515 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,515 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,515 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:56,515 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,515 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,515 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:56,515 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,516 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,516 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:56,516 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,516 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,517 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testSpecificDeletesFollowedByDeleteFamily1 is still present, removing 2014-06-15 07:45:56,517 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,517 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' with timeout 60000ms 2014-06-15 07:45:56,517 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:56,517 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'acquire' stage 2014-06-15 07:45:56,518 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally acquired 2014-06-15 07:45:56,518 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily1) in zk 2014-06-15 07:45:56,519 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,519 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,519 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:56,519 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testSpecificDeletesFollowedByDeleteFamily1 is still present, removing 2014-06-15 07:45:56,520 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testSpecificDeletesFollowedByDeleteFamily1 is still present, removing 2014-06-15 07:45:56,520 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,520 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,520 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' with timeout 60000ms 2014-06-15 07:45:56,520 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' with timeout 60000ms 2014-06-15 07:45:56,520 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:56,520 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:56,520 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'acquire' stage 2014-06-15 07:45:56,520 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'acquire' stage 2014-06-15 07:45:56,520 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally acquired 2014-06-15 07:45:56,520 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:56,521 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:56,521 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:56,521 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily1) in zk 2014-06-15 07:45:56,521 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. started... 2014-06-15 07:45:56,521 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] regionserver.HRegion(1696): Started memstore flush for testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2., current region memstore size 416 B 2014-06-15 07:45:56,522 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,523 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,523 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:56,539 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:56,540 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741871_1047 size 5230 2014-06-15 07:45:56,542 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=20, memsize=416, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/.tmp/55f6cafc3c474246977b12d060002648 2014-06-15 07:45:56,550 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55f6cafc3c474246977b12d060002648 2014-06-15 07:45:56,552 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/.tmp/55f6cafc3c474246977b12d060002648 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/info/55f6cafc3c474246977b12d060002648 2014-06-15 07:45:56,563 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55f6cafc3c474246977b12d060002648 2014-06-15 07:45:56,564 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/info/55f6cafc3c474246977b12d060002648, entries=3, sequenceid=20, filesize=5.1 K 2014-06-15 07:45:56,564 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~416 B/416, currentsize=0 B/0 for region testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. in 43ms, sequenceid=20, compaction requested=false 2014-06-15 07:45:56,564 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool61-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:45:56,564 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:56,565 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:56,565 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,565 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally acquired 2014-06-15 07:45:56,565 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily1) in zk 2014-06-15 07:45:56,567 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,567 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,567 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,567 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,567 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,567 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:56,567 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,568 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:56,568 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:56,568 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:56,569 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,569 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,569 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:56,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:56,571 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testSpecificDeletesFollowedByDeleteFamily1' on coordinator 2014-06-15 07:45:56,571 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@133872a[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:56,571 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testSpecificDeletesFollowedByDeleteFamily1' starting 'in-barrier' execution. 2014-06-15 07:45:56,571 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,572 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,573 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,573 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,573 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,573 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,572 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,573 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' received 'reached' from coordinator. 2014-06-15 07:45:56,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,573 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally completed 2014-06-15 07:45:56,574 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' received 'reached' from coordinator. 2014-06-15 07:45:56,574 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily1' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:56,574 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally completed 2014-06-15 07:45:56,573 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,574 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily1' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:56,574 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,574 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,574 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:56,574 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' received 'reached' from coordinator. 2014-06-15 07:45:56,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:56,575 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' locally completed 2014-06-15 07:45:56,575 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily1' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:56,576 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' has notified controller of completion 2014-06-15 07:45:56,576 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:56,576 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' completed. 2014-06-15 07:45:56,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:56,577 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' has notified controller of completion 2014-06-15 07:45:56,578 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:56,578 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' completed. 2014-06-15 07:45:56,578 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' has notified controller of completion 2014-06-15 07:45:56,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,578 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:56,578 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily1' completed. 2014-06-15 07:45:56,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,579 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,579 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:56,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:56,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,582 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testSpecificDeletesFollowedByDeleteFamily1' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:56,583 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,583 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:56,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:56,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:56,584 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,585 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,585 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,585 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,586 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:56,586 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:56,586 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,587 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:56,587 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:56,587 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:56,588 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testSpecificDeletesFollowedByDeleteFamily1' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:56,588 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testSpecificDeletesFollowedByDeleteFamily1', counting down latch. Waiting for 0 more 2014-06-15 07:45:56,588 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testSpecificDeletesFollowedByDeleteFamily1' execution completed 2014-06-15 07:45:56,588 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:56,588 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:56,588 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testSpecificDeletesFollowedByDeleteFamily1 2014-06-15 07:45:56,588 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testSpecificDeletesFollowedByDeleteFamily1including nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:56,653 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,654 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,654 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,654 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,654 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,654 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,654 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:56,655 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:56,655 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:56,664 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:56,664 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testSpecificDeletesFollowedByDeleteFamily1' 2014-06-15 07:45:56,665 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:56,665 DEBUG [Thread-548] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testSpecificDeletesFollowedByDeleteFamily1'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:56,665 DEBUG [Thread-548] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:56,766 DEBUG [Thread-548] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:56,767 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:56,768 DEBUG [Thread-548] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:56,810 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testSpecificDeletesFollowedByDeleteFamily1 Thread=375 (was 376), OpenFileDescriptor=566 (was 567), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=583 (was 583), ProcessCount=176 (was 176), AvailableMemoryMB=3044 (was 3083), ConnectionCount=8 (was 8) 2014-06-15 07:45:56,837 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction Thread=375, OpenFileDescriptor=568, MaxFileDescriptor=60000, SystemLoadAverage=583, ProcessCount=176, AvailableMemoryMB=3045, ConnectionCount=8 2014-06-15 07:45:57,013 DEBUG [RpcServer.handler=2,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:45:57,017 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:45:57,021 INFO [RpcServer.handler=4,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:45:57,031 DEBUG [RpcServer.handler=4,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/write-master:458120000000000 2014-06-15 07:45:57,045 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,067 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:57,069 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:57,085 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/.tabledesc/.tableinfo.0000000001 2014-06-15 07:45:57,088 INFO [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction HTD == 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,115 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:57,117 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741873_1049 size 104 2014-06-15 07:45:57,121 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction-1] regionserver.HRegion(646): Instantiated testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,121 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction-1] regionserver.HRegion(1116): Closing testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164.: disabling compactions & flushes 2014-06-15 07:45:57,121 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,121 INFO [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction-1] regionserver.HRegion(1225): Closed testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,131 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:45:57,133 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,133 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 2b637e5e3798f63e357998c82819f164 with OFFLINE state 2014-06-15 07:45:57,135 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:57,136 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={2b637e5e3798f63e357998c82819f164 state=OFFLINE, ts=1402818357132, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,136 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={2b637e5e3798f63e357998c82819f164 state=OFFLINE, ts=1402818357132, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,138 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:45:57,138 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {2b637e5e3798f63e357998c82819f164 state=OFFLINE, ts=1402818357133, server=null} to {2b637e5e3798f63e357998c82819f164 state=PENDING_OPEN, ts=1402818357138, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:57,139 INFO [Priority.RpcServer.handler=4,port=57332] regionserver.RSRpcServices(1230): Open testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,146 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 2b637e5e3798f63e357998c82819f164 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:57,147 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,147 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction state from ENABLING to ENABLED 2014-06-15 07:45:57,149 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/2b637e5e3798f63e357998c82819f164 2014-06-15 07:45:57,149 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 2b637e5e3798f63e357998c82819f164 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:45:57,150 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(4462): Opening region: {ENCODED => 2b637e5e3798f63e357998c82819f164, NAME => 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:45:57,150 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. service=VisibilityLabelsService 2014-06-15 07:45:57,150 INFO [RS_OPEN_REGION-asf008:57332-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:45:57,150 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2b637e5e3798f63e357998c82819f164 2014-06-15 07:45:57,151 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(646): Instantiated testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,151 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/write-master:458120000000000 2014-06-15 07:45:57,151 DEBUG [AM.ZK.Worker-pool3-t15] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=2b637e5e3798f63e357998c82819f164, current_state={2b637e5e3798f63e357998c82819f164 state=PENDING_OPEN, ts=1402818357138, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:57,152 INFO [AM.ZK.Worker-pool3-t15] master.RegionStates(813): Transition {2b637e5e3798f63e357998c82819f164 state=PENDING_OPEN, ts=1402818357138, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {2b637e5e3798f63e357998c82819f164 state=OPENING, ts=1402818357152, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:57,159 INFO [StoreOpener-2b637e5e3798f63e357998c82819f164-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:57,159 INFO [StoreOpener-2b637e5e3798f63e357998c82819f164-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:45:57,161 DEBUG [StoreOpener-2b637e5e3798f63e357998c82819f164-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info 2014-06-15 07:45:57,163 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164 2014-06-15 07:45:57,165 INFO [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(747): Onlined 2b637e5e3798f63e357998c82819f164; next sequenceid=2 2014-06-15 07:45:57,165 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 2b637e5e3798f63e357998c82819f164 2014-06-15 07:45:57,166 INFO [PostOpenDeployTasks:2b637e5e3798f63e357998c82819f164] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,171 INFO [PostOpenDeployTasks:2b637e5e3798f63e357998c82819f164] catalog.MetaEditor(464): Updated row testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,171 DEBUG [PostOpenDeployTasks:2b637e5e3798f63e357998c82819f164] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,172 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 2b637e5e3798f63e357998c82819f164 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:57,175 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 2b637e5e3798f63e357998c82819f164 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:45:57,175 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/2b637e5e3798f63e357998c82819f164 2014-06-15 07:45:57,175 DEBUG [RS_OPEN_REGION-asf008:57332-0] coordination.ZkOpenRegionCoordination(91): Transitioned 2b637e5e3798f63e357998c82819f164 to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,175 DEBUG [RS_OPEN_REGION-asf008:57332-0] handler.OpenRegionHandler(167): Opened testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,176 DEBUG [AM.ZK.Worker-pool3-t18] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=2b637e5e3798f63e357998c82819f164, current_state={2b637e5e3798f63e357998c82819f164 state=OPENING, ts=1402818357152, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:57,176 INFO [AM.ZK.Worker-pool3-t18] master.RegionStates(813): Transition {2b637e5e3798f63e357998c82819f164 state=OPENING, ts=1402818357152, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {2b637e5e3798f63e357998c82819f164 state=OPEN, ts=1402818357176, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:57,177 DEBUG [AM.ZK.Worker-pool3-t18] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 2b637e5e3798f63e357998c82819f164 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:45:57,179 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/2b637e5e3798f63e357998c82819f164 2014-06-15 07:45:57,179 DEBUG [AM.ZK.Worker-pool3-t18] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 2b637e5e3798f63e357998c82819f164 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:45:57,180 DEBUG [AM.ZK.Worker-pool3-t18] master.AssignmentManager$4(1293): Znode testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. deleted, state: {2b637e5e3798f63e357998c82819f164 state=OPEN, ts=1402818357176, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:45:57,180 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:45:57,180 INFO [AM.ZK.Worker-pool3-t18] master.RegionStates(359): Onlined 2b637e5e3798f63e357998c82819f164 on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,363 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:57,363 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,365 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:57,365 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:57,366 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003e connected 2014-06-15 07:45:57,370 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,393 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:57,393 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,439 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:57,439 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:57,440 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003f connected 2014-06-15 07:45:57,451 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:57,452 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,455 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:57,455 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:57,456 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0040 connected 2014-06-15 07:45:57,460 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0040, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,465 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:57,474 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' 2014-06-15 07:45:57,474 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:57,474 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' 2014-06-15 07:45:57,474 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', kicking off acquire phase on members. 2014-06-15 07:45:57,475 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,475 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,477 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,477 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,477 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,477 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,477 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,477 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,477 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,477 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,478 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,478 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,478 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,478 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,478 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:57,478 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,478 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,478 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:57,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:57,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,479 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,479 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,479 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,480 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,480 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:57,480 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:57,480 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,480 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,480 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:57,480 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,480 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:57,481 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:57,481 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,481 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:57,481 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool63-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,480 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:57,481 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool63-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. started... 2014-06-15 07:45:57,481 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:57,481 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:57,482 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool63-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164., current region memstore size 712 B 2014-06-15 07:45:57,482 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:57,481 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:57,482 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:57,483 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:57,483 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:57,483 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:57,483 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:57,487 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,491 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,491 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,491 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:57,492 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,492 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:57,510 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:57,511 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:57,514 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool63-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/e47c55479eab49d18bef1c6e54e95763 2014-06-15 07:45:57,523 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool63-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/e47c55479eab49d18bef1c6e54e95763 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/e47c55479eab49d18bef1c6e54e95763 2014-06-15 07:45:57,540 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool63-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/e47c55479eab49d18bef1c6e54e95763, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:45:57,540 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool63-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. in 58ms, sequenceid=13, compaction requested=false 2014-06-15 07:45:57,541 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool63-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,541 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:57,542 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:57,542 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,542 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:57,542 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:57,544 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,544 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,544 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,544 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,544 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,544 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,545 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:57,545 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:57,545 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:57,545 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:57,546 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,546 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,546 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,547 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,547 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:57,548 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:57,548 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' on coordinator 2014-06-15 07:45:57,548 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@51fa1d[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:57,548 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'in-barrier' execution. 2014-06-15 07:45:57,549 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,550 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,550 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,550 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,550 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,550 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,550 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,551 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:57,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,551 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:57,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:57,551 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:57,550 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,551 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:57,552 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:57,552 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:57,552 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:57,552 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,551 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:57,552 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:57,552 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:57,565 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:57,565 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:57,565 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:57,565 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:57,567 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:57,567 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:57,568 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:57,568 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:57,568 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,568 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:57,568 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:57,569 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,569 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,569 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:57,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:57,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,571 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,571 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,572 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,573 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:57,573 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,573 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:57,573 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:57,574 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:57,574 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:57,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:57,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,577 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,577 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,577 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:57,578 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', counting down latch. Waiting for 0 more 2014-06-15 07:45:57,578 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' execution completed 2014-06-15 07:45:57,578 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:57,578 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:57,578 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,578 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:57,585 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,585 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,585 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,585 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,585 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,585 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,585 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,586 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,586 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,591 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:57,591 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' 2014-06-15 07:45:57,591 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:57,592 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:57,592 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:57,692 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:57,694 DEBUG [RpcServer.handler=2,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:57,695 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a003f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,703 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:57,703 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,705 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:57,706 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:57,707 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0041 connected 2014-06-15 07:45:57,726 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:57,726 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,729 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:57,730 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:57,732 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0042 connected 2014-06-15 07:45:57,734 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0042, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:57,737 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:57,743 DEBUG [RpcServer.handler=3,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:57,743 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' 2014-06-15 07:45:57,744 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:57,744 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' 2014-06-15 07:45:57,744 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', kicking off acquire phase on members. 2014-06-15 07:45:57,745 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,745 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,755 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,755 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,755 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,755 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,755 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,755 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,756 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,756 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,756 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,756 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,756 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:57,757 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,757 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,757 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,757 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,757 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,757 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:57,757 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,757 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,758 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:57,758 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,758 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,758 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:57,758 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,758 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,758 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:57,759 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:57,758 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:57,759 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,759 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:57,759 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:57,759 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:57,759 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:57,759 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool66-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,759 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,759 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:57,760 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:57,760 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool66-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. started... 2014-06-15 07:45:57,759 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:57,760 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:57,760 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool66-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164., current region memstore size 144 B 2014-06-15 07:45:57,760 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:57,761 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,761 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,761 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:57,761 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,761 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:57,761 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:57,762 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:57,762 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:57,762 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:57,773 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,788 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,788 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,789 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:57,789 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,789 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:57,802 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:57,803 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:45:57,807 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool66-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/4476105213ec4890b9144ad19bebeb57 2014-06-15 07:45:57,818 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool66-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/4476105213ec4890b9144ad19bebeb57 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/4476105213ec4890b9144ad19bebeb57 2014-06-15 07:45:57,837 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool66-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/4476105213ec4890b9144ad19bebeb57, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:45:57,838 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool66-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. in 77ms, sequenceid=16, compaction requested=false 2014-06-15 07:45:57,838 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool66-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:57,838 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:57,842 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:57,842 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,843 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:57,843 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:57,845 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,845 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,845 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,845 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,845 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,845 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,846 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:57,846 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:57,846 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:57,846 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:57,847 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,847 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,847 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,848 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,848 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:57,849 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:57,850 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' on coordinator 2014-06-15 07:45:57,850 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@40b718[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:57,850 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'in-barrier' execution. 2014-06-15 07:45:57,850 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,851 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,851 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,851 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,851 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,852 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,852 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,852 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,852 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:57,852 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:57,852 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:57,852 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,851 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,852 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:57,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,852 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:57,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:57,853 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:57,853 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:57,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:57,854 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:57,854 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:57,857 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:57,857 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:57,857 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:57,857 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:57,859 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:57,859 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:57,859 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:57,897 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,897 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:57,897 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:57,897 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:57,897 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,898 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,898 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,898 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:57,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:57,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,900 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,900 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,900 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:57,900 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,901 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:57,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:57,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:57,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:57,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:57,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:57,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:57,905 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:57,905 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:57,905 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', counting down latch. Waiting for 0 more 2014-06-15 07:45:57,905 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' execution completed 2014-06-15 07:45:57,905 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:57,906 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:57,906 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:57,906 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:57,923 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,923 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,923 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:57,923 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,923 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,924 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,924 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,923 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:57,924 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:57,934 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:57,934 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' 2014-06-15 07:45:57,934 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:57,935 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:57,935 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:58,035 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:58,036 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:58,037 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0041, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,050 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:58,050 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,053 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:58,053 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:58,054 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0043 connected 2014-06-15 07:45:58,064 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:58,065 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,066 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:58,066 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:58,067 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0044 connected 2014-06-15 07:45:58,070 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0044, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,072 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:58,077 DEBUG [RpcServer.handler=1,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:58,077 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' 2014-06-15 07:45:58,077 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:58,077 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' 2014-06-15 07:45:58,077 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', kicking off acquire phase on members. 2014-06-15 07:45:58,078 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,078 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,079 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,079 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,080 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,080 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,080 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,080 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,080 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,080 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,080 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,080 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,081 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,080 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,081 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:58,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,081 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,081 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:58,082 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,082 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,082 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,082 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:58,082 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,082 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:58,082 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,082 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,082 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:58,082 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:58,083 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:58,083 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,083 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:58,083 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:58,083 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:58,083 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:58,083 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:58,083 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:58,082 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:58,084 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:58,084 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:58,084 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool70-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:58,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,084 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool70-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. started... 2014-06-15 07:45:58,084 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,084 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool70-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164., current region memstore size 136 B 2014-06-15 07:45:58,085 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:58,085 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,085 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:58,085 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,085 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:58,085 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:58,085 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:58,085 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:58,086 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,086 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:58,087 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,088 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,088 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:58,115 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:58,116 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:58,120 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool70-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=136, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/cf8bb096979c4834afa7ffe33e78802f 2014-06-15 07:45:58,131 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool70-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/cf8bb096979c4834afa7ffe33e78802f as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/cf8bb096979c4834afa7ffe33e78802f 2014-06-15 07:45:58,158 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool70-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/cf8bb096979c4834afa7ffe33e78802f, entries=1, sequenceid=19, filesize=4.8 K 2014-06-15 07:45:58,158 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool70-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. in 74ms, sequenceid=19, compaction requested=true 2014-06-15 07:45:58,158 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool70-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:58,158 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:58,159 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:58,159 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,159 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:58,159 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:58,162 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,162 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,163 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,163 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,163 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,163 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:58,163 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,163 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:58,163 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:58,164 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:58,164 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,165 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,165 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,166 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,167 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:58,167 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:58,167 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' on coordinator 2014-06-15 07:45:58,168 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@abff46[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:58,168 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'in-barrier' execution. 2014-06-15 07:45:58,168 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,170 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,170 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,170 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,170 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,171 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,171 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,170 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,171 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,171 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,171 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:58,171 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:58,171 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,171 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:58,172 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:58,172 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:58,171 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:58,172 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:58,172 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:58,172 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:58,172 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,172 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:58,172 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:58,173 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:58,174 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:58,174 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:58,174 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:58,174 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:58,175 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:58,175 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:58,177 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:58,177 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:58,177 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:58,177 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,177 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,178 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,178 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,179 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:58,179 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:58,179 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,179 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,180 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,180 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,181 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:58,181 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,181 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,181 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,181 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,181 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:58,181 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:58,182 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:58,182 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,183 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,183 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,183 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,184 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:58,184 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:58,184 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,185 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,185 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,186 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,186 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:58,186 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' execution completed 2014-06-15 07:45:58,186 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:58,186 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:58,187 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,187 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:58,187 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', counting down latch. Waiting for 0 more 2014-06-15 07:45:58,194 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,194 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,194 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,194 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,194 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,195 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,195 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,194 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,195 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,202 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:58,202 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' 2014-06-15 07:45:58,202 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:58,203 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:58,203 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:58,303 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:58,304 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:58,305 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0043, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,312 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:58,313 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,318 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:58,319 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:58,319 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0045 connected 2014-06-15 07:45:58,333 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:58,334 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,337 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:58,337 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:58,338 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0046 connected 2014-06-15 07:45:58,343 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0046, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,346 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:45:58,351 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction was in running list but was completed. Accepting new attempt. 2014-06-15 07:45:58,351 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' 2014-06-15 07:45:58,351 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:58,351 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' 2014-06-15 07:45:58,352 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', kicking off acquire phase on members. 2014-06-15 07:45:58,352 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,352 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,355 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,355 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,355 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,355 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,355 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,356 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,356 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,356 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:45:58,356 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,356 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,358 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,358 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,358 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,358 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,358 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,358 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:58,358 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,358 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,359 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:58,359 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,359 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,359 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:58,359 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:58,359 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,359 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:58,359 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:58,359 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:58,359 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:58,360 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,360 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,360 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:45:58,360 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,360 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,360 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:58,360 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,360 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction is still present, removing 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:58,361 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' with timeout 60000ms 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,361 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'acquire' stage 2014-06-15 07:45:58,362 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:45:58,362 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool74-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:58,362 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:45:58,362 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool74-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. started... 2014-06-15 07:45:58,362 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,362 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:58,363 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool74-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164., current region memstore size 144 B 2014-06-15 07:45:58,365 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,366 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,366 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:58,432 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:58,433 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:45:58,439 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool74-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=22, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/0391eae5d9914c2c98de0da135cc8d6d 2014-06-15 07:45:58,459 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool74-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/0391eae5d9914c2c98de0da135cc8d6d as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/0391eae5d9914c2c98de0da135cc8d6d 2014-06-15 07:45:58,470 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool74-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/0391eae5d9914c2c98de0da135cc8d6d, entries=1, sequenceid=22, filesize=4.8 K 2014-06-15 07:45:58,471 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool74-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. in 108ms, sequenceid=22, compaction requested=true 2014-06-15 07:45:58,471 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool74-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:58,471 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:45:58,472 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:45:58,472 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,472 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally acquired 2014-06-15 07:45:58,472 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction) in zk 2014-06-15 07:45:58,474 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,474 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,474 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,474 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:58,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:58,475 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,475 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:45:58,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:58,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,476 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,476 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,476 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,477 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:58,477 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:58,477 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' on coordinator 2014-06-15 07:45:58,478 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@45e90f[Count = 0] remaining members to acquire global barrier 2014-06-15 07:45:58,478 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' starting 'in-barrier' execution. 2014-06-15 07:45:58,478 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,479 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,479 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,479 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,479 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,479 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,480 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:58,480 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:58,480 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:58,480 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:58,480 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:45:58,479 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,480 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:45:58,480 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,481 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:58,481 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:58,480 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,481 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,481 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:45:58,481 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' locally completed 2014-06-15 07:45:58,481 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:58,481 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:45:58,483 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:58,483 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:58,483 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,483 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:58,483 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:58,483 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:58,483 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:58,484 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,484 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' has notified controller of completion 2014-06-15 07:45:58,485 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:58,485 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' completed. 2014-06-15 07:45:58,485 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,485 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,485 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:58,486 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:58,486 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,487 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,487 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,488 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,488 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' is trying to release an unknown procedure 'reached' 2014-06-15 07:45:58,488 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,488 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,488 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:45:58,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:45:58,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:45:58,489 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,490 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,490 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,490 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,491 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:45:58,491 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:45:58,491 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,492 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:45:58,492 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:45:58,492 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:45:58,493 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:45:58,493 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction', counting down latch. Waiting for 0 more 2014-06-15 07:45:58,493 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' execution completed 2014-06-15 07:45:58,547 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:45:58,547 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:45:58,547 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction 2014-06-15 07:45:58,547 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:45:58,552 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,552 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,552 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,552 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,552 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,552 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,552 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:45:58,553 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:45:58,553 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:45:58,580 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:45:58,580 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction' 2014-06-15 07:45:58,580 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:45:58,581 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction'' to complete. (max 1714 ms per retry) 2014-06-15 07:45:58,581 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:45:58,681 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:45:58,683 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:45:58,683 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0045, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,686 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:45:58,686 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:45:58,689 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:45:58,690 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0047 connected 2014-06-15 07:45:58,713 INFO [Priority.RpcServer.handler=7,port=57332] regionserver.RSRpcServices(939): Compacting testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:58,713 DEBUG [Priority.RpcServer.handler=7,port=57332] compactions.RatioBasedCompactionPolicy(92): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 10 blocking 2014-06-15 07:45:58,715 DEBUG [Priority.RpcServer.handler=7,port=57332] regionserver.HStore(1420): 2b637e5e3798f63e357998c82819f164 - info: Initiating major compaction (all files) 2014-06-15 07:45:58,716 DEBUG [Priority.RpcServer.handler=7,port=57332] regionserver.CompactSplitThread(319): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1360218; Because: User-triggered major compaction; compaction_queue=(0:0), split_queue=0, merge_queue=0 2014-06-15 07:45:58,717 INFO [RS:0;asf008:57332-shortCompactions-1402818358716] regionserver.HRegion(1490): Starting compaction on info in region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:45:58,719 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0047, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:45:58,720 INFO [RS:0;asf008:57332-shortCompactions-1402818358716] regionserver.HStore(1074): Starting compaction of 4 file(s) in info of testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. into tmpdir=hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp, totalSize=19.5 K 2014-06-15 07:45:58,723 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] compactions.Compactor(145): Compacting hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/e47c55479eab49d18bef1c6e54e95763, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, seqNum=13, earliestPutTs=123 2014-06-15 07:45:58,724 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] compactions.Compactor(145): Compacting hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/4476105213ec4890b9144ad19bebeb57, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, seqNum=16, earliestPutTs=127 2014-06-15 07:45:58,724 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] compactions.Compactor(145): Compacting hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/cf8bb096979c4834afa7ffe33e78802f, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, seqNum=19, earliestPutTs=9223372036854775807 2014-06-15 07:45:58,725 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] compactions.Compactor(145): Compacting hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/0391eae5d9914c2c98de0da135cc8d6d, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, seqNum=22, earliestPutTs=127 2014-06-15 07:45:58,741 INFO [RS:0;asf008:57332-shortCompactions-1402818358716] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:45:58,763 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:58,765 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:45:58,792 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/.tmp/d368807666d743dd965ac11d1cde5b29 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/d368807666d743dd965ac11d1cde5b29 2014-06-15 07:45:58,811 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] regionserver.HStore(1530): Removing store files after compaction... 2014-06-15 07:45:58,829 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/e47c55479eab49d18bef1c6e54e95763, to hdfs://localhost:37161/user/jenkins/hbase/archive/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/e47c55479eab49d18bef1c6e54e95763 2014-06-15 07:45:58,833 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/4476105213ec4890b9144ad19bebeb57, to hdfs://localhost:37161/user/jenkins/hbase/archive/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/4476105213ec4890b9144ad19bebeb57 2014-06-15 07:45:58,836 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/cf8bb096979c4834afa7ffe33e78802f, to hdfs://localhost:37161/user/jenkins/hbase/archive/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/cf8bb096979c4834afa7ffe33e78802f 2014-06-15 07:45:58,840 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/0391eae5d9914c2c98de0da135cc8d6d, to hdfs://localhost:37161/user/jenkins/hbase/archive/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction/2b637e5e3798f63e357998c82819f164/info/0391eae5d9914c2c98de0da135cc8d6d 2014-06-15 07:45:58,840 INFO [RS:0;asf008:57332-shortCompactions-1402818358716] regionserver.HStore(1196): Completed major compaction of 4 (all) file(s) in info of testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. into d368807666d743dd965ac11d1cde5b29(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2014-06-15 07:45:58,841 INFO [RS:0;asf008:57332-shortCompactions-1402818358716] regionserver.CompactSplitThread$CompactionRunner(477): Completed compaction: Request = regionName=testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164., storeName=info, fileCount=4, fileSize=19.5 K, priority=1, time=3780430781519794; duration=0sec 2014-06-15 07:45:58,842 DEBUG [RS:0;asf008:57332-shortCompactions-1402818358716] regionserver.CompactSplitThread$CompactionRunner(499): CompactSplitThread Status: compaction_queue=(0:0), split_queue=0, merge_queue=0 2014-06-15 07:46:03,756 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction Thread=366 (was 375), OpenFileDescriptor=553 (was 568), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=576 (was 583), ProcessCount=176 (was 176), AvailableMemoryMB=2805 (was 3045), ConnectionCount=8 (was 8) 2014-06-15 07:46:03,782 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 Thread=366, OpenFileDescriptor=555, MaxFileDescriptor=60000, SystemLoadAverage=576, ProcessCount=176, AvailableMemoryMB=2805, ConnectionCount=8 2014-06-15 07:46:03,812 DEBUG [RpcServer.handler=3,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:03,813 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:03,815 INFO [RpcServer.handler=2,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:03,820 DEBUG [RpcServer.handler=2,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/write-master:458120000000000 2014-06-15 07:46:03,825 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:03,840 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:03,841 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:04,609 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:04,611 INFO [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 HTD == 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:04,627 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:04,628 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:04,631 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1-1] regionserver.HRegion(646): Instantiated testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:04,632 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1-1] regionserver.HRegion(1116): Closing testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86.: disabling compactions & flushes 2014-06-15 07:46:04,632 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:04,632 INFO [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1-1] regionserver.HRegion(1225): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:04,637 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:04,638 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:04,638 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node d6228b4ad06925b7c71aa056548abd86 with OFFLINE state 2014-06-15 07:46:04,640 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:04,640 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={d6228b4ad06925b7c71aa056548abd86 state=OFFLINE, ts=1402818364638, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:04,640 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={d6228b4ad06925b7c71aa056548abd86 state=OFFLINE, ts=1402818364638, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:04,644 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:04,644 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {d6228b4ad06925b7c71aa056548abd86 state=OFFLINE, ts=1402818364638, server=null} to {d6228b4ad06925b7c71aa056548abd86 state=PENDING_OPEN, ts=1402818364644, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:04,645 INFO [Priority.RpcServer.handler=8,port=57332] regionserver.RSRpcServices(1230): Open testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:04,650 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning d6228b4ad06925b7c71aa056548abd86 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:04,650 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:04,650 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 state from ENABLING to ENABLED 2014-06-15 07:46:04,657 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d6228b4ad06925b7c71aa056548abd86 2014-06-15 07:46:04,657 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node d6228b4ad06925b7c71aa056548abd86 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:04,658 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(4462): Opening region: {ENCODED => d6228b4ad06925b7c71aa056548abd86, NAME => 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:04,658 DEBUG [AM.ZK.Worker-pool3-t20] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=d6228b4ad06925b7c71aa056548abd86, current_state={d6228b4ad06925b7c71aa056548abd86 state=PENDING_OPEN, ts=1402818364644, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:04,658 INFO [AM.ZK.Worker-pool3-t20] master.RegionStates(813): Transition {d6228b4ad06925b7c71aa056548abd86 state=PENDING_OPEN, ts=1402818364644, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {d6228b4ad06925b7c71aa056548abd86 state=OPENING, ts=1402818364658, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:04,658 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. service=VisibilityLabelsService 2014-06-15 07:46:04,659 INFO [RS_OPEN_REGION-asf008:57332-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:04,659 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 d6228b4ad06925b7c71aa056548abd86 2014-06-15 07:46:04,659 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(646): Instantiated testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:04,660 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/write-master:458120000000000 2014-06-15 07:46:04,668 INFO [StoreOpener-d6228b4ad06925b7c71aa056548abd86-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:04,668 INFO [StoreOpener-d6228b4ad06925b7c71aa056548abd86-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:04,670 DEBUG [StoreOpener-d6228b4ad06925b7c71aa056548abd86-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/info 2014-06-15 07:46:04,671 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86 2014-06-15 07:46:04,673 INFO [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(747): Onlined d6228b4ad06925b7c71aa056548abd86; next sequenceid=2 2014-06-15 07:46:04,673 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node d6228b4ad06925b7c71aa056548abd86 2014-06-15 07:46:04,676 INFO [PostOpenDeployTasks:d6228b4ad06925b7c71aa056548abd86] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:04,681 INFO [PostOpenDeployTasks:d6228b4ad06925b7c71aa056548abd86] catalog.MetaEditor(464): Updated row testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:04,681 DEBUG [PostOpenDeployTasks:d6228b4ad06925b7c71aa056548abd86] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:04,681 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning d6228b4ad06925b7c71aa056548abd86 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:04,683 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node d6228b4ad06925b7c71aa056548abd86 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:04,683 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d6228b4ad06925b7c71aa056548abd86 2014-06-15 07:46:04,683 DEBUG [RS_OPEN_REGION-asf008:57332-1] coordination.ZkOpenRegionCoordination(91): Transitioned d6228b4ad06925b7c71aa056548abd86 to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:04,683 DEBUG [RS_OPEN_REGION-asf008:57332-1] handler.OpenRegionHandler(167): Opened testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:04,683 DEBUG [AM.ZK.Worker-pool3-t2] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=d6228b4ad06925b7c71aa056548abd86, current_state={d6228b4ad06925b7c71aa056548abd86 state=OPENING, ts=1402818364658, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:04,684 INFO [AM.ZK.Worker-pool3-t2] master.RegionStates(813): Transition {d6228b4ad06925b7c71aa056548abd86 state=OPENING, ts=1402818364658, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {d6228b4ad06925b7c71aa056548abd86 state=OPEN, ts=1402818364684, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:04,684 DEBUG [AM.ZK.Worker-pool3-t2] coordination.ZkOpenRegionCoordination(350): Handling OPENED of d6228b4ad06925b7c71aa056548abd86 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:04,685 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/d6228b4ad06925b7c71aa056548abd86 2014-06-15 07:46:04,685 DEBUG [AM.ZK.Worker-pool3-t2] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node d6228b4ad06925b7c71aa056548abd86 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:04,685 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:04,686 DEBUG [AM.ZK.Worker-pool3-t2] master.AssignmentManager$4(1293): Znode testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. deleted, state: {d6228b4ad06925b7c71aa056548abd86 state=OPEN, ts=1402818364684, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:04,686 INFO [AM.ZK.Worker-pool3-t2] master.RegionStates(359): Onlined d6228b4ad06925b7c71aa056548abd86 on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:04,950 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:04,950 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:04,952 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:04,953 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:04,954 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0048 connected 2014-06-15 07:46:04,958 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0048, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:04,978 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:04,978 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:04,980 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:04,981 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:04,982 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0049 connected 2014-06-15 07:46:04,998 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:04,998 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,000 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:05,000 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:05,002 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004a connected 2014-06-15 07:46:05,007 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,013 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:05,019 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' 2014-06-15 07:46:05,019 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:05,019 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' starting 'acquire' 2014-06-15 07:46:05,019 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1', kicking off acquire phase on members. 2014-06-15 07:46:05,020 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,020 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,022 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,022 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,022 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,022 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,022 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,023 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,023 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,024 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,024 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:05,024 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:05,025 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,026 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,026 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,026 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,026 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' with timeout 60000ms 2014-06-15 07:46:05,026 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:05,026 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,026 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' starting 'acquire' stage 2014-06-15 07:46:05,026 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' with timeout 60000ms 2014-06-15 07:46:05,026 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' locally acquired 2014-06-15 07:46:05,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:05,027 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1) in zk 2014-06-15 07:46:05,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' starting 'acquire' stage 2014-06-15 07:46:05,026 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' locally acquired 2014-06-15 07:46:05,027 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' with timeout 60000ms 2014-06-15 07:46:05,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1) in zk 2014-06-15 07:46:05,027 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:05,028 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' starting 'acquire' stage 2014-06-15 07:46:05,028 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:05,028 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool76-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:05,028 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:05,028 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool76-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. started... 2014-06-15 07:46:05,029 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool76-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86., current region memstore size 712 B 2014-06-15 07:46:05,029 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,030 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,030 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:05,031 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,031 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,032 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:05,055 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:05,055 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:05,060 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool76-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/.tmp/daf63a32346b464baed5e96463bfbd78 2014-06-15 07:46:05,071 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool76-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/.tmp/daf63a32346b464baed5e96463bfbd78 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/info/daf63a32346b464baed5e96463bfbd78 2014-06-15 07:46:05,082 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool76-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/info/daf63a32346b464baed5e96463bfbd78, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:05,082 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool76-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. in 53ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:05,082 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool76-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:05,082 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:05,083 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:05,083 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,083 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' locally acquired 2014-06-15 07:46:05,083 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1) in zk 2014-06-15 07:46:05,123 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,123 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,123 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,124 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:05,124 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:05,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:05,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:05,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,126 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,126 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:05,126 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:05,127 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' on coordinator 2014-06-15 07:46:05,127 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@c66375[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:05,127 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' starting 'in-barrier' execution. 2014-06-15 07:46:05,127 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,128 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,128 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,129 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,129 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,128 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,129 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' received 'reached' from coordinator. 2014-06-15 07:46:05,129 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,129 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,129 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,129 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,129 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' locally completed 2014-06-15 07:46:05,129 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,129 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' received 'reached' from coordinator. 2014-06-15 07:46:05,130 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' locally completed 2014-06-15 07:46:05,130 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:05,129 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:05,129 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' received 'reached' from coordinator. 2014-06-15 07:46:05,130 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' locally completed 2014-06-15 07:46:05,130 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:05,129 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,131 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:05,131 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:05,132 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' has notified controller of completion 2014-06-15 07:46:05,132 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:05,132 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:05,133 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' completed. 2014-06-15 07:46:05,133 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' has notified controller of completion 2014-06-15 07:46:05,133 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:05,133 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' completed. 2014-06-15 07:46:05,133 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' has notified controller of completion 2014-06-15 07:46:05,133 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,133 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:05,133 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' completed. 2014-06-15 07:46:05,134 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,134 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,134 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,135 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:05,135 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:05,135 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,136 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,136 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,136 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,137 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:05,137 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,137 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,137 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,137 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,137 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:05,137 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:05,138 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:05,138 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,138 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,139 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,139 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,139 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:05,140 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:05,140 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,140 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:05,142 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' execution completed 2014-06-15 07:46:05,142 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:05,143 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:05,143 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 2014-06-15 07:46:05,143 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1including nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:05,143 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1', counting down latch. Waiting for 0 more 2014-06-15 07:46:05,155 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,155 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,155 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,155 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,156 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,155 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,157 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,156 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,157 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,172 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:05,172 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1' 2014-06-15 07:46:05,172 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:05,173 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:05,173 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:05,273 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:05,275 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:05,275 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0049, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,325 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1 Thread=368 (was 366) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:39986 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=563 (was 555) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=546 (was 576), ProcessCount=176 (was 176), AvailableMemoryMB=3164 (was 2805) - AvailableMemoryMB LEAK? -, ConnectionCount=8 (was 8) 2014-06-15 07:46:05,345 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 Thread=368, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=546, ProcessCount=176, AvailableMemoryMB=3161, ConnectionCount=8 2014-06-15 07:46:05,374 DEBUG [RpcServer.handler=4,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:05,376 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:05,378 INFO [RpcServer.handler=4,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:05,382 DEBUG [RpcServer.handler=4,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/write-master:458120000000000 2014-06-15 07:46:05,386 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,402 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:05,403 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741882_1058 size 342 2014-06-15 07:46:05,408 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:05,410 INFO [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 HTD == 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,429 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:05,430 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741883_1059 size 95 2014-06-15 07:46:05,432 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2-1] regionserver.HRegion(646): Instantiated testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,432 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2-1] regionserver.HRegion(1116): Closing testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1.: disabling compactions & flushes 2014-06-15 07:46:05,432 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,432 INFO [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2-1] regionserver.HRegion(1225): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,438 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:05,439 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,439 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 65bd33597f025ccf7a588fc1bed9f3d1 with OFFLINE state 2014-06-15 07:46:05,440 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:05,441 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={65bd33597f025ccf7a588fc1bed9f3d1 state=OFFLINE, ts=1402818365439, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,441 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={65bd33597f025ccf7a588fc1bed9f3d1 state=OFFLINE, ts=1402818365439, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,444 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:05,444 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {65bd33597f025ccf7a588fc1bed9f3d1 state=OFFLINE, ts=1402818365439, server=null} to {65bd33597f025ccf7a588fc1bed9f3d1 state=PENDING_OPEN, ts=1402818365444, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:05,445 INFO [Priority.RpcServer.handler=3,port=47197] regionserver.RSRpcServices(1230): Open testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,452 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,453 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 state from ENABLING to ENABLED 2014-06-15 07:46:05,453 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 65bd33597f025ccf7a588fc1bed9f3d1 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:05,473 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/65bd33597f025ccf7a588fc1bed9f3d1 2014-06-15 07:46:05,473 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 65bd33597f025ccf7a588fc1bed9f3d1 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:05,474 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(4462): Opening region: {ENCODED => 65bd33597f025ccf7a588fc1bed9f3d1, NAME => 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:05,474 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/write-master:458120000000000 2014-06-15 07:46:05,475 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. service=VisibilityLabelsService 2014-06-15 07:46:05,475 DEBUG [AM.ZK.Worker-pool3-t5] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=65bd33597f025ccf7a588fc1bed9f3d1, current_state={65bd33597f025ccf7a588fc1bed9f3d1 state=PENDING_OPEN, ts=1402818365444, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:05,475 INFO [RS_OPEN_REGION-asf008:47197-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:05,475 INFO [AM.ZK.Worker-pool3-t5] master.RegionStates(813): Transition {65bd33597f025ccf7a588fc1bed9f3d1 state=PENDING_OPEN, ts=1402818365444, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {65bd33597f025ccf7a588fc1bed9f3d1 state=OPENING, ts=1402818365475, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:05,475 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 65bd33597f025ccf7a588fc1bed9f3d1 2014-06-15 07:46:05,475 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(646): Instantiated testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,481 INFO [StoreOpener-65bd33597f025ccf7a588fc1bed9f3d1-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:05,482 INFO [StoreOpener-65bd33597f025ccf7a588fc1bed9f3d1-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:05,483 DEBUG [StoreOpener-65bd33597f025ccf7a588fc1bed9f3d1-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/info 2014-06-15 07:46:05,484 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1 2014-06-15 07:46:05,486 INFO [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(747): Onlined 65bd33597f025ccf7a588fc1bed9f3d1; next sequenceid=2 2014-06-15 07:46:05,486 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 65bd33597f025ccf7a588fc1bed9f3d1 2014-06-15 07:46:05,487 INFO [PostOpenDeployTasks:65bd33597f025ccf7a588fc1bed9f3d1] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,490 INFO [PostOpenDeployTasks:65bd33597f025ccf7a588fc1bed9f3d1] catalog.MetaEditor(464): Updated row testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,490 DEBUG [PostOpenDeployTasks:65bd33597f025ccf7a588fc1bed9f3d1] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,491 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 65bd33597f025ccf7a588fc1bed9f3d1 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:05,494 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/65bd33597f025ccf7a588fc1bed9f3d1 2014-06-15 07:46:05,494 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 65bd33597f025ccf7a588fc1bed9f3d1 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:05,495 DEBUG [RS_OPEN_REGION-asf008:47197-0] coordination.ZkOpenRegionCoordination(91): Transitioned 65bd33597f025ccf7a588fc1bed9f3d1 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,495 DEBUG [RS_OPEN_REGION-asf008:47197-0] handler.OpenRegionHandler(167): Opened testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,495 DEBUG [AM.ZK.Worker-pool3-t8] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=65bd33597f025ccf7a588fc1bed9f3d1, current_state={65bd33597f025ccf7a588fc1bed9f3d1 state=OPENING, ts=1402818365475, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:05,495 INFO [AM.ZK.Worker-pool3-t8] master.RegionStates(813): Transition {65bd33597f025ccf7a588fc1bed9f3d1 state=OPENING, ts=1402818365475, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {65bd33597f025ccf7a588fc1bed9f3d1 state=OPEN, ts=1402818365495, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:05,495 DEBUG [AM.ZK.Worker-pool3-t8] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 65bd33597f025ccf7a588fc1bed9f3d1 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:05,496 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:05,497 DEBUG [AM.ZK.Worker-pool3-t8] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 65bd33597f025ccf7a588fc1bed9f3d1 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:05,497 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,496 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/65bd33597f025ccf7a588fc1bed9f3d1 2014-06-15 07:46:05,497 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:05,497 DEBUG [AM.ZK.Worker-pool3-t6] master.AssignmentManager$4(1293): Znode testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. deleted, state: {65bd33597f025ccf7a588fc1bed9f3d1 state=OPEN, ts=1402818365495, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:05,497 INFO [AM.ZK.Worker-pool3-t6] master.RegionStates(359): Onlined 65bd33597f025ccf7a588fc1bed9f3d1 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,498 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:05,499 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:05,499 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004b connected 2014-06-15 07:46:05,505 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,560 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:05,560 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,562 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:05,562 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:05,564 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004c connected 2014-06-15 07:46:05,576 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:05,577 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,578 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:05,578 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:05,579 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004d connected 2014-06-15 07:46:05,586 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,589 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:05,597 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' 2014-06-15 07:46:05,598 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:05,598 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' starting 'acquire' 2014-06-15 07:46:05,598 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2', kicking off acquire phase on members. 2014-06-15 07:46:05,598 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,599 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,601 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,601 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,601 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,601 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,602 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,602 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,602 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,602 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,602 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:05,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:05,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,604 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:05,604 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,604 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,604 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,604 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,604 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' with timeout 60000ms 2014-06-15 07:46:05,604 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,604 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:05,605 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' with timeout 60000ms 2014-06-15 07:46:05,605 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' starting 'acquire' stage 2014-06-15 07:46:05,605 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:05,605 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' locally acquired 2014-06-15 07:46:05,605 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' starting 'acquire' stage 2014-06-15 07:46:05,605 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2) in zk 2014-06-15 07:46:05,604 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,605 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:05,606 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' with timeout 60000ms 2014-06-15 07:46:05,606 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:05,606 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:05,606 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool80-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,606 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' starting 'acquire' stage 2014-06-15 07:46:05,606 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool80-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. started... 2014-06-15 07:46:05,606 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' locally acquired 2014-06-15 07:46:05,606 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2) in zk 2014-06-15 07:46:05,607 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool80-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1., current region memstore size 712 B 2014-06-15 07:46:05,607 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,607 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,607 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:05,609 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,609 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,609 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:05,624 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:05,626 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741884_1060 size 5165 2014-06-15 07:46:05,628 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool80-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/.tmp/ff603683628842548740a926f1da9119 2014-06-15 07:46:05,637 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool80-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/.tmp/ff603683628842548740a926f1da9119 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/info/ff603683628842548740a926f1da9119 2014-06-15 07:46:05,645 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool80-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/info/ff603683628842548740a926f1da9119, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:05,645 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool80-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. in 38ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:05,645 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool80-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:05,645 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:05,647 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:05,647 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,647 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' locally acquired 2014-06-15 07:46:05,647 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2) in zk 2014-06-15 07:46:05,649 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,649 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,649 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,649 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,649 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:05,649 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:05,649 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,650 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:05,650 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,650 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:05,650 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,650 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,650 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,651 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,651 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:05,651 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:05,652 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' on coordinator 2014-06-15 07:46:05,652 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@f368dc[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:05,652 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' starting 'in-barrier' execution. 2014-06-15 07:46:05,652 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,653 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,653 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,653 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,653 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,653 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,653 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,653 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,654 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' received 'reached' from coordinator. 2014-06-15 07:46:05,653 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,654 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' locally completed 2014-06-15 07:46:05,654 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,654 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:05,654 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,654 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,655 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:05,654 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' received 'reached' from coordinator. 2014-06-15 07:46:05,655 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' received 'reached' from coordinator. 2014-06-15 07:46:05,655 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:05,655 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' locally completed 2014-06-15 07:46:05,655 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' locally completed 2014-06-15 07:46:05,655 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:05,655 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:05,656 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' has notified controller of completion 2014-06-15 07:46:05,656 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:05,656 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:05,656 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' completed. 2014-06-15 07:46:05,657 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' has notified controller of completion 2014-06-15 07:46:05,657 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:05,657 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' has notified controller of completion 2014-06-15 07:46:05,657 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' completed. 2014-06-15 07:46:05,657 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:05,658 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' completed. 2014-06-15 07:46:05,658 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,658 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,658 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,658 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,660 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:05,660 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:05,660 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,661 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,662 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,662 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,663 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:05,663 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,663 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,663 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,663 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,663 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:05,663 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:05,663 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:05,664 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,664 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,664 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,665 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,665 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:05,665 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:05,665 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,666 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:05,666 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:05,666 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:05,667 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:05,667 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2', counting down latch. Waiting for 0 more 2014-06-15 07:46:05,667 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' execution completed 2014-06-15 07:46:05,668 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:05,668 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:05,668 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 2014-06-15 07:46:05,668 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2including nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:05,673 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,673 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,673 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,673 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,673 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,673 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,676 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:05,676 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:05,676 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:05,692 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:05,692 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2' 2014-06-15 07:46:05,693 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:05,693 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:05,693 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:05,794 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:05,795 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:05,796 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:05,812 ERROR [RpcServer.handler=3,port=47197] ipc.RpcServer(2042): Unexpected throwable object java.lang.AssertionError at org.apache.hadoop.hbase.security.visibility.VisibilityScanDeleteTracker.isDeleted(VisibilityScanDeleteTracker.java:235) at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:366) at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:490) at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:139) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3893) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3973) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3842) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3833) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:1948) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29497) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2005) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:221) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:43) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:162) at java.lang.Thread.run(Thread.java:662) 2014-06-15 07:46:06,121 ERROR [RpcServer.handler=0,port=47197] ipc.RpcServer(2042): Unexpected throwable object java.lang.AssertionError at org.apache.hadoop.hbase.security.visibility.VisibilityScanDeleteTracker.isDeleted(VisibilityScanDeleteTracker.java:235) at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:366) at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:490) at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:139) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3893) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3973) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3842) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3833) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:1948) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29497) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2005) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:221) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:43) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:162) at java.lang.Thread.run(Thread.java:662) 2014-06-15 07:46:06,448 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2 Thread=370 (was 368) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:40014 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-196598018_8 at /127.0.0.1:36045 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=561 (was 565), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=546 (was 546), ProcessCount=176 (was 176), AvailableMemoryMB=3059 (was 3161), ConnectionCount=8 (was 8) 2014-06-15 07:46:06,467 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnswithMultipleColumnsWithMultipleVersions Thread=371, OpenFileDescriptor=563, MaxFileDescriptor=60000, SystemLoadAverage=546, ProcessCount=176, AvailableMemoryMB=3053, ConnectionCount=8 2014-06-15 07:46:06,496 DEBUG [RpcServer.handler=3,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:06,498 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:06,501 INFO [RpcServer.handler=0,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnswithMultipleColumnsWithMultipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:06,508 DEBUG [RpcServer.handler=0,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnswithMultipleColumnsWithMultipleVersions/write-master:458120000000000 2014-06-15 07:46:06,513 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,536 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:06,538 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741885_1061 size 336 2014-06-15 07:46:06,545 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:06,547 INFO [RegionOpenAndInitThread-testDeleteColumnswithMultipleColumnsWithMultipleVersions-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnswithMultipleColumnsWithMultipleVersions HTD == 'testDeleteColumnswithMultipleColumnsWithMultipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,572 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:06,574 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:06,576 DEBUG [RegionOpenAndInitThread-testDeleteColumnswithMultipleColumnsWithMultipleVersions-1] regionserver.HRegion(646): Instantiated testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,576 DEBUG [RegionOpenAndInitThread-testDeleteColumnswithMultipleColumnsWithMultipleVersions-1] regionserver.HRegion(1116): Closing testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb.: disabling compactions & flushes 2014-06-15 07:46:06,576 DEBUG [RegionOpenAndInitThread-testDeleteColumnswithMultipleColumnsWithMultipleVersions-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,577 INFO [RegionOpenAndInitThread-testDeleteColumnswithMultipleColumnsWithMultipleVersions-1] regionserver.HRegion(1225): Closed testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,581 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:06,582 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,582 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node d7c098d61154585ffc988b8a383845eb with OFFLINE state 2014-06-15 07:46:06,584 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:06,584 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={d7c098d61154585ffc988b8a383845eb state=OFFLINE, ts=1402818366582, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,584 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={d7c098d61154585ffc988b8a383845eb state=OFFLINE, ts=1402818366582, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,590 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:06,590 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {d7c098d61154585ffc988b8a383845eb state=OFFLINE, ts=1402818366582, server=null} to {d7c098d61154585ffc988b8a383845eb state=PENDING_OPEN, ts=1402818366590, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:06,591 INFO [Priority.RpcServer.handler=9,port=57332] regionserver.RSRpcServices(1230): Open testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,597 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,597 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning d7c098d61154585ffc988b8a383845eb from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:06,597 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnswithMultipleColumnsWithMultipleVersions state from ENABLING to ENABLED 2014-06-15 07:46:06,599 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d7c098d61154585ffc988b8a383845eb 2014-06-15 07:46:06,599 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node d7c098d61154585ffc988b8a383845eb from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:06,600 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(4462): Opening region: {ENCODED => d7c098d61154585ffc988b8a383845eb, NAME => 'testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:06,600 DEBUG [AM.ZK.Worker-pool3-t10] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=d7c098d61154585ffc988b8a383845eb, current_state={d7c098d61154585ffc988b8a383845eb state=PENDING_OPEN, ts=1402818366590, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:06,600 INFO [AM.ZK.Worker-pool3-t10] master.RegionStates(813): Transition {d7c098d61154585ffc988b8a383845eb state=PENDING_OPEN, ts=1402818366590, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {d7c098d61154585ffc988b8a383845eb state=OPENING, ts=1402818366600, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:06,600 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnswithMultipleColumnsWithMultipleVersions/write-master:458120000000000 2014-06-15 07:46:06,600 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. service=VisibilityLabelsService 2014-06-15 07:46:06,601 INFO [RS_OPEN_REGION-asf008:57332-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:06,601 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnswithMultipleColumnsWithMultipleVersions d7c098d61154585ffc988b8a383845eb 2014-06-15 07:46:06,601 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(646): Instantiated testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,606 INFO [StoreOpener-d7c098d61154585ffc988b8a383845eb-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:06,607 INFO [StoreOpener-d7c098d61154585ffc988b8a383845eb-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:06,608 DEBUG [StoreOpener-d7c098d61154585ffc988b8a383845eb-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/info 2014-06-15 07:46:06,609 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb 2014-06-15 07:46:06,611 INFO [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(747): Onlined d7c098d61154585ffc988b8a383845eb; next sequenceid=2 2014-06-15 07:46:06,611 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node d7c098d61154585ffc988b8a383845eb 2014-06-15 07:46:06,612 INFO [PostOpenDeployTasks:d7c098d61154585ffc988b8a383845eb] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,616 INFO [PostOpenDeployTasks:d7c098d61154585ffc988b8a383845eb] catalog.MetaEditor(464): Updated row testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,616 DEBUG [PostOpenDeployTasks:d7c098d61154585ffc988b8a383845eb] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,616 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning d7c098d61154585ffc988b8a383845eb from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:06,620 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node d7c098d61154585ffc988b8a383845eb from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:06,620 DEBUG [RS_OPEN_REGION-asf008:57332-2] coordination.ZkOpenRegionCoordination(91): Transitioned d7c098d61154585ffc988b8a383845eb to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,620 DEBUG [RS_OPEN_REGION-asf008:57332-2] handler.OpenRegionHandler(167): Opened testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,622 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d7c098d61154585ffc988b8a383845eb 2014-06-15 07:46:06,622 DEBUG [AM.ZK.Worker-pool3-t11] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=d7c098d61154585ffc988b8a383845eb, current_state={d7c098d61154585ffc988b8a383845eb state=OPENING, ts=1402818366600, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:06,623 INFO [AM.ZK.Worker-pool3-t11] master.RegionStates(813): Transition {d7c098d61154585ffc988b8a383845eb state=OPENING, ts=1402818366600, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {d7c098d61154585ffc988b8a383845eb state=OPEN, ts=1402818366623, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:06,623 DEBUG [AM.ZK.Worker-pool3-t11] coordination.ZkOpenRegionCoordination(350): Handling OPENED of d7c098d61154585ffc988b8a383845eb from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:06,625 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/d7c098d61154585ffc988b8a383845eb 2014-06-15 07:46:06,625 DEBUG [AM.ZK.Worker-pool3-t11] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node d7c098d61154585ffc988b8a383845eb in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:06,625 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:06,625 DEBUG [AM.ZK.Worker-pool3-t11] master.AssignmentManager$4(1293): Znode testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. deleted, state: {d7c098d61154585ffc988b8a383845eb state=OPEN, ts=1402818366623, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:06,625 INFO [AM.ZK.Worker-pool3-t11] master.RegionStates(359): Onlined d7c098d61154585ffc988b8a383845eb on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,629 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:06,629 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:06,630 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:06,635 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004e connected 2014-06-15 07:46:06,635 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004e, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:06,641 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:06,669 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:06,669 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:06,671 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:06,672 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:06,673 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004f connected 2014-06-15 07:46:06,685 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:06,686 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:06,689 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:06,689 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:06,693 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0050 connected 2014-06-15 07:46:06,707 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0050, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:06,710 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:06,717 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' 2014-06-15 07:46:06,717 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:06,717 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'acquire' 2014-06-15 07:46:06,717 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:06,718 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,718 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,720 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:06,720 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,720 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:06,720 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:06,720 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,720 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:06,720 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:06,720 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:06,720 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:06,720 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:06,721 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:06,721 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:06,721 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,721 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,721 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,721 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,722 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,723 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,724 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,724 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,724 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:46:06,724 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:06,724 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:06,724 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:46:06,724 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:06,724 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:06,724 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally acquired 2014-06-15 07:46:06,724 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnswithMultipleColumnsWithMultipleVersions) in zk 2014-06-15 07:46:06,725 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,725 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:46:06,725 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:06,725 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:06,725 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:06,725 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:06,725 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool81-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,725 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally acquired 2014-06-15 07:46:06,726 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool81-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. started... 2014-06-15 07:46:06,726 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnswithMultipleColumnsWithMultipleVersions) in zk 2014-06-15 07:46:06,727 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,727 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool81-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb., current region memstore size 712 B 2014-06-15 07:46:06,727 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,727 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:06,728 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,729 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,729 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:06,753 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:06,755 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741887_1063 size 5163 2014-06-15 07:46:06,756 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool81-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/.tmp/bd688d65a2ab4414852f6529ca8ee250 2014-06-15 07:46:06,767 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool81-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/.tmp/bd688d65a2ab4414852f6529ca8ee250 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/info/bd688d65a2ab4414852f6529ca8ee250 2014-06-15 07:46:06,780 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool81-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/info/bd688d65a2ab4414852f6529ca8ee250, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:06,780 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool81-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. in 53ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:06,780 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool81-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:06,781 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:06,781 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:06,781 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,781 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally acquired 2014-06-15 07:46:06,781 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnswithMultipleColumnsWithMultipleVersions) in zk 2014-06-15 07:46:06,783 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,783 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,783 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,783 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,784 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,784 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:06,784 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:06,784 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,784 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:06,784 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:06,785 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,785 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:06,786 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,786 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:06,786 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:06,787 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:06,788 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' on coordinator 2014-06-15 07:46:06,788 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@163da81[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:06,788 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:06,788 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,842 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,842 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,842 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,842 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,843 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,843 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,843 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:06,843 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally completed 2014-06-15 07:46:06,843 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:06,843 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:06,843 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally completed 2014-06-15 07:46:06,843 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,844 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,843 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:06,844 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,843 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,844 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,844 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:06,844 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:06,844 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:06,844 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally completed 2014-06-15 07:46:06,845 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:06,847 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:46:06,847 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:06,847 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed. 2014-06-15 07:46:06,848 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:46:06,848 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:06,848 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed. 2014-06-15 07:46:06,848 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:06,850 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:46:06,850 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,850 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:06,850 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed. 2014-06-15 07:46:06,850 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:06,851 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,851 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:06,851 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:06,852 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:06,852 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,852 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:06,852 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:06,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,853 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:06,853 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,853 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:06,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:06,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:06,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,855 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:06,855 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,855 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:06,855 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:06,856 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:06,857 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,857 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:06,857 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:06,858 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:06,858 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:06,858 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteColumnswithMultipleColumnsWithMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:06,858 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' execution completed 2014-06-15 07:46:06,859 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:06,859 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:06,859 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:06,859 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnswithMultipleColumnsWithMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:06,866 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:06,866 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:06,866 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:06,866 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:06,866 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:06,866 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:06,866 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:06,866 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:06,867 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:06,874 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:06,874 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' 2014-06-15 07:46:06,874 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:06,874 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnswithMultipleColumnsWithMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:06,875 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:06,975 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:06,977 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:06,977 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a004f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,051 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:07,051 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,052 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:07,052 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:07,053 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0051 connected 2014-06-15 07:46:07,064 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:07,064 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,068 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:07,068 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:07,069 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0052 connected 2014-06-15 07:46:07,072 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0052, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,077 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:07,081 DEBUG [RpcServer.handler=1,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnswithMultipleColumnsWithMultipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:07,081 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' 2014-06-15 07:46:07,081 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:07,081 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'acquire' 2014-06-15 07:46:07,082 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:07,082 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,082 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,083 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,083 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,084 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,084 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,083 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,083 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,084 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,085 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,085 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,085 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:07,085 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,084 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,085 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:07,085 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,085 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,086 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:07,086 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,086 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnswithMultipleColumnsWithMultipleVersions is still present, removing 2014-06-15 07:46:07,086 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,086 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,086 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,086 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:46:07,086 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnswithMultipleColumnsWithMultipleVersions is still present, removing 2014-06-15 07:46:07,087 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:07,087 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,087 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:07,087 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:46:07,087 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,087 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:07,087 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally acquired 2014-06-15 07:46:07,087 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnswithMultipleColumnsWithMultipleVersions) in zk 2014-06-15 07:46:07,087 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:07,088 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:07,088 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,088 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:07,088 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,088 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:07,088 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool85-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:07,088 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnswithMultipleColumnsWithMultipleVersions is still present, removing 2014-06-15 07:46:07,088 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool85-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. started... 2014-06-15 07:46:07,088 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,089 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' with timeout 60000ms 2014-06-15 07:46:07,089 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool85-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb., current region memstore size 136 B 2014-06-15 07:46:07,089 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:07,089 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:07,089 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally acquired 2014-06-15 07:46:07,089 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnswithMultipleColumnsWithMultipleVersions) in zk 2014-06-15 07:46:07,090 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,091 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,091 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:07,091 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,092 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,092 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:07,108 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:07,110 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:07,116 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool85-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=136, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/.tmp/24baaed5b39b4c09966161730658b017 2014-06-15 07:46:07,125 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool85-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/.tmp/24baaed5b39b4c09966161730658b017 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/info/24baaed5b39b4c09966161730658b017 2014-06-15 07:46:07,137 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool85-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnswithMultipleColumnsWithMultipleVersions/d7c098d61154585ffc988b8a383845eb/info/24baaed5b39b4c09966161730658b017, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:46:07,137 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool85-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. in 48ms, sequenceid=16, compaction requested=false 2014-06-15 07:46:07,137 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool85-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:07,137 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:07,138 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:07,138 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,138 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally acquired 2014-06-15 07:46:07,138 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnswithMultipleColumnsWithMultipleVersions) in zk 2014-06-15 07:46:07,140 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,140 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,140 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,140 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,141 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:07,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:07,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:07,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:07,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,144 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:07,144 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:07,144 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' on coordinator 2014-06-15 07:46:07,144 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@4307f2[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:07,144 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:07,145 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,146 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,146 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,146 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,146 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,146 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,146 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,146 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,146 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,147 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:07,147 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:07,147 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally completed 2014-06-15 07:46:07,147 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally completed 2014-06-15 07:46:07,147 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:07,147 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:07,146 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,148 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,148 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,148 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:07,148 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:07,148 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:07,148 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' locally completed 2014-06-15 07:46:07,148 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:07,148 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:46:07,149 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:07,149 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed. 2014-06-15 07:46:07,149 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:07,152 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:46:07,152 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:07,152 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed. 2014-06-15 07:46:07,197 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' has notified controller of completion 2014-06-15 07:46:07,197 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,197 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:07,197 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' completed. 2014-06-15 07:46:07,198 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,198 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,198 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,198 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:07,199 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:07,199 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,199 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,200 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,200 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,202 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:07,202 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,202 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,202 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,202 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnswithMultipleColumnsWithMultipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,202 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:07,202 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:07,202 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:07,203 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,203 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,203 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,203 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,204 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:07,204 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:07,204 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,205 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,205 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,205 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:07,206 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteColumnswithMultipleColumnsWithMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:07,206 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' execution completed 2014-06-15 07:46:07,206 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:07,206 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:07,206 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnswithMultipleColumnsWithMultipleVersions 2014-06-15 07:46:07,206 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnswithMultipleColumnsWithMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:07,216 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,216 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,216 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,216 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,217 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,217 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,216 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,217 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,217 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,223 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:07,224 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnswithMultipleColumnsWithMultipleVersions' 2014-06-15 07:46:07,224 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:07,224 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnswithMultipleColumnsWithMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:07,224 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:07,325 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:07,326 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:07,327 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0051, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,485 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnswithMultipleColumnsWithMultipleVersions Thread=373 (was 371) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:36082 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:40046 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:36045 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=573 (was 563) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=546 (was 546), ProcessCount=176 (was 176), AvailableMemoryMB=3780 (was 3053) - AvailableMemoryMB LEAK? -, ConnectionCount=8 (was 8) 2014-06-15 07:46:07,509 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testMultipleDeleteFamilyVersionWithDiffLabels Thread=374, OpenFileDescriptor=575, MaxFileDescriptor=60000, SystemLoadAverage=546, ProcessCount=176, AvailableMemoryMB=3778, ConnectionCount=8 2014-06-15 07:46:07,605 DEBUG [RpcServer.handler=4,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:07,607 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:07,610 INFO [RpcServer.handler=1,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testMultipleDeleteFamilyVersionWithDiffLabels', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:07,617 DEBUG [RpcServer.handler=1,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testMultipleDeleteFamilyVersionWithDiffLabels/write-master:458120000000000 2014-06-15 07:46:07,622 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,637 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:07,638 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:07,647 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:07,649 INFO [RegionOpenAndInitThread-testMultipleDeleteFamilyVersionWithDiffLabels-1] regionserver.HRegion(4277): creating HRegion testMultipleDeleteFamilyVersionWithDiffLabels HTD == 'testMultipleDeleteFamilyVersionWithDiffLabels', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,663 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:07,665 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:07,668 DEBUG [RegionOpenAndInitThread-testMultipleDeleteFamilyVersionWithDiffLabels-1] regionserver.HRegion(646): Instantiated testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,668 DEBUG [RegionOpenAndInitThread-testMultipleDeleteFamilyVersionWithDiffLabels-1] regionserver.HRegion(1116): Closing testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60.: disabling compactions & flushes 2014-06-15 07:46:07,669 DEBUG [RegionOpenAndInitThread-testMultipleDeleteFamilyVersionWithDiffLabels-1] regionserver.HRegion(1143): Updates disabled for region testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,669 INFO [RegionOpenAndInitThread-testMultipleDeleteFamilyVersionWithDiffLabels-1] regionserver.HRegion(1225): Closed testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,674 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:07,675 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,675 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node da04879e5c51927a3089f81497b31a60 with OFFLINE state 2014-06-15 07:46:07,677 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:07,677 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={da04879e5c51927a3089f81497b31a60 state=OFFLINE, ts=1402818367675, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,678 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={da04879e5c51927a3089f81497b31a60 state=OFFLINE, ts=1402818367675, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,680 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:07,680 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {da04879e5c51927a3089f81497b31a60 state=OFFLINE, ts=1402818367675, server=null} to {da04879e5c51927a3089f81497b31a60 state=PENDING_OPEN, ts=1402818367680, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:07,681 INFO [Priority.RpcServer.handler=4,port=47197] regionserver.RSRpcServices(1230): Open testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,687 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,687 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testMultipleDeleteFamilyVersionWithDiffLabels state from ENABLING to ENABLED 2014-06-15 07:46:07,688 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning da04879e5c51927a3089f81497b31a60 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:07,692 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testMultipleDeleteFamilyVersionWithDiffLabels/write-master:458120000000000 2014-06-15 07:46:07,692 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node da04879e5c51927a3089f81497b31a60 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:07,692 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/da04879e5c51927a3089f81497b31a60 2014-06-15 07:46:07,692 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(4462): Opening region: {ENCODED => da04879e5c51927a3089f81497b31a60, NAME => 'testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:07,693 DEBUG [AM.ZK.Worker-pool3-t15] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=da04879e5c51927a3089f81497b31a60, current_state={da04879e5c51927a3089f81497b31a60 state=PENDING_OPEN, ts=1402818367680, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:07,693 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(5559): Registered coprocessor service: region=testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. service=VisibilityLabelsService 2014-06-15 07:46:07,693 INFO [AM.ZK.Worker-pool3-t15] master.RegionStates(813): Transition {da04879e5c51927a3089f81497b31a60 state=PENDING_OPEN, ts=1402818367680, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {da04879e5c51927a3089f81497b31a60 state=OPENING, ts=1402818367693, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:07,693 INFO [RS_OPEN_REGION-asf008:47197-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:07,694 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testMultipleDeleteFamilyVersionWithDiffLabels da04879e5c51927a3089f81497b31a60 2014-06-15 07:46:07,694 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(646): Instantiated testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,699 INFO [StoreOpener-da04879e5c51927a3089f81497b31a60-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:07,700 INFO [StoreOpener-da04879e5c51927a3089f81497b31a60-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:07,701 DEBUG [StoreOpener-da04879e5c51927a3089f81497b31a60-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/info 2014-06-15 07:46:07,702 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60 2014-06-15 07:46:07,704 INFO [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(747): Onlined da04879e5c51927a3089f81497b31a60; next sequenceid=2 2014-06-15 07:46:07,704 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node da04879e5c51927a3089f81497b31a60 2014-06-15 07:46:07,705 INFO [PostOpenDeployTasks:da04879e5c51927a3089f81497b31a60] regionserver.HRegionServer(1663): Post open deploy tasks for testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,710 INFO [PostOpenDeployTasks:da04879e5c51927a3089f81497b31a60] catalog.MetaEditor(464): Updated row testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,710 DEBUG [PostOpenDeployTasks:da04879e5c51927a3089f81497b31a60] regionserver.HRegionServer(1693): Finished post open deploy task for testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,711 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning da04879e5c51927a3089f81497b31a60 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:07,712 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node da04879e5c51927a3089f81497b31a60 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:07,712 DEBUG [RS_OPEN_REGION-asf008:47197-1] coordination.ZkOpenRegionCoordination(91): Transitioned da04879e5c51927a3089f81497b31a60 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,712 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/da04879e5c51927a3089f81497b31a60 2014-06-15 07:46:07,712 DEBUG [RS_OPEN_REGION-asf008:47197-1] handler.OpenRegionHandler(167): Opened testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,713 DEBUG [AM.ZK.Worker-pool3-t16] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=da04879e5c51927a3089f81497b31a60, current_state={da04879e5c51927a3089f81497b31a60 state=OPENING, ts=1402818367693, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:07,713 INFO [AM.ZK.Worker-pool3-t16] master.RegionStates(813): Transition {da04879e5c51927a3089f81497b31a60 state=OPENING, ts=1402818367693, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {da04879e5c51927a3089f81497b31a60 state=OPEN, ts=1402818367713, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:07,713 DEBUG [AM.ZK.Worker-pool3-t16] coordination.ZkOpenRegionCoordination(350): Handling OPENED of da04879e5c51927a3089f81497b31a60 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:07,715 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/da04879e5c51927a3089f81497b31a60 2014-06-15 07:46:07,715 DEBUG [AM.ZK.Worker-pool3-t16] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node da04879e5c51927a3089f81497b31a60 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:07,715 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:07,715 DEBUG [AM.ZK.Worker-pool3-t16] master.AssignmentManager$4(1293): Znode testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. deleted, state: {da04879e5c51927a3089f81497b31a60 state=OPEN, ts=1402818367713, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:07,715 INFO [AM.ZK.Worker-pool3-t16] master.RegionStates(359): Onlined da04879e5c51927a3089f81497b31a60 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,732 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:07,733 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,733 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:07,733 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:07,735 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0053 connected 2014-06-15 07:46:07,737 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0053, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,778 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:07,778 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,779 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:07,780 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:07,781 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0054 connected 2014-06-15 07:46:07,795 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:07,795 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,795 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:07,797 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:07,798 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0055 connected 2014-06-15 07:46:07,801 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0055, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:07,817 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:07,821 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' 2014-06-15 07:46:07,821 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:07,821 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'acquire' 2014-06-15 07:46:07,821 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testMultipleDeleteFamilyVersionWithDiffLabels', kicking off acquire phase on members. 2014-06-15 07:46:07,822 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,822 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,825 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,825 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,825 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,826 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,825 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,826 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,826 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:07,826 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,826 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,826 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,827 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,827 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,827 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,827 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,827 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,827 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:07,827 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,827 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:07,827 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,828 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,828 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,828 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,828 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,828 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,829 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:07,829 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,829 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,834 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,834 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' with timeout 60000ms 2014-06-15 07:46:07,834 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,834 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,835 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' with timeout 60000ms 2014-06-15 07:46:07,835 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' with timeout 60000ms 2014-06-15 07:46:07,834 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:07,835 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:07,835 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:07,835 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'acquire' stage 2014-06-15 07:46:07,835 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'acquire' stage 2014-06-15 07:46:07,835 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally acquired 2014-06-15 07:46:07,835 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'acquire' stage 2014-06-15 07:46:07,836 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testMultipleDeleteFamilyVersionWithDiffLabels) in zk 2014-06-15 07:46:07,836 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally acquired 2014-06-15 07:46:07,836 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testMultipleDeleteFamilyVersionWithDiffLabels) in zk 2014-06-15 07:46:07,836 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:07,837 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:07,837 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool88-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,837 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool88-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. started... 2014-06-15 07:46:07,838 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool88-thread-1] regionserver.HRegion(1696): Started memstore flush for testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60., current region memstore size 712 B 2014-06-15 07:46:07,838 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,839 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,840 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,840 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:07,840 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,840 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:07,868 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:07,869 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741891_1067 size 5165 2014-06-15 07:46:07,870 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool88-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/.tmp/fada85e0dc0442ca80ebb4dcd1d2c3e1 2014-06-15 07:46:07,878 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool88-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/.tmp/fada85e0dc0442ca80ebb4dcd1d2c3e1 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/info/fada85e0dc0442ca80ebb4dcd1d2c3e1 2014-06-15 07:46:07,887 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool88-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/info/fada85e0dc0442ca80ebb4dcd1d2c3e1, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:07,887 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool88-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. in 49ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:07,887 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool88-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:07,888 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:07,888 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:07,888 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,888 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally acquired 2014-06-15 07:46:07,888 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testMultipleDeleteFamilyVersionWithDiffLabels) in zk 2014-06-15 07:46:07,890 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,890 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,890 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:07,890 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:07,890 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:07,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:07,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,892 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,892 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:07,892 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:07,892 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' on coordinator 2014-06-15 07:46:07,893 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@2c1b1c[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:07,893 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'in-barrier' execution. 2014-06-15 07:46:07,893 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,894 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,894 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,894 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,894 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,894 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,894 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,895 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' received 'reached' from coordinator. 2014-06-15 07:46:07,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,895 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' received 'reached' from coordinator. 2014-06-15 07:46:07,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:07,895 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally completed 2014-06-15 07:46:07,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:07,896 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:07,895 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,895 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally completed 2014-06-15 07:46:07,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,896 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:07,896 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' received 'reached' from coordinator. 2014-06-15 07:46:07,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:07,896 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally completed 2014-06-15 07:46:07,897 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:07,897 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,899 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' has notified controller of completion 2014-06-15 07:46:07,899 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:07,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,899 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed. 2014-06-15 07:46:07,899 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' has notified controller of completion 2014-06-15 07:46:07,900 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:07,900 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed. 2014-06-15 07:46:07,900 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' has notified controller of completion 2014-06-15 07:46:07,900 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,900 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:07,900 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed. 2014-06-15 07:46:07,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:07,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:07,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,903 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testMultipleDeleteFamilyVersionWithDiffLabels' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:07,903 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,903 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:07,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:07,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:07,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,905 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:07,905 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:07,905 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,906 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:07,906 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:07,906 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:07,907 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:07,907 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testMultipleDeleteFamilyVersionWithDiffLabels', counting down latch. Waiting for 0 more 2014-06-15 07:46:07,907 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' execution completed 2014-06-15 07:46:07,907 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:07,907 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:07,907 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:07,907 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testMultipleDeleteFamilyVersionWithDiffLabelsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:07,912 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,912 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,912 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,912 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,912 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,912 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,912 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:07,913 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:07,913 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:07,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:07,917 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testMultipleDeleteFamilyVersionWithDiffLabels' 2014-06-15 07:46:07,917 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:07,917 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testMultipleDeleteFamilyVersionWithDiffLabels'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:07,918 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:08,018 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:08,020 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:08,020 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0054, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:08,044 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:08,044 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:08,046 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:08,046 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:08,048 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0056 connected 2014-06-15 07:46:08,066 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:08,066 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:08,069 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:08,070 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:08,072 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:08,073 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0057 connected 2014-06-15 07:46:08,076 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:08,093 DEBUG [RpcServer.handler=0,port=45812] procedure.ProcedureCoordinator(158): Procedure testMultipleDeleteFamilyVersionWithDiffLabels was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:08,094 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' 2014-06-15 07:46:08,094 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:08,094 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'acquire' 2014-06-15 07:46:08,094 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testMultipleDeleteFamilyVersionWithDiffLabels', kicking off acquire phase on members. 2014-06-15 07:46:08,095 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,095 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,096 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:08,096 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,097 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:08,096 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:08,097 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,097 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:08,096 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:08,097 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:08,097 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:08,097 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:08,098 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:08,097 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:08,098 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,098 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,098 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,098 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,099 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,100 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,110 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testMultipleDeleteFamilyVersionWithDiffLabels is still present, removing 2014-06-15 07:46:08,110 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,110 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' with timeout 60000ms 2014-06-15 07:46:08,110 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:08,110 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'acquire' stage 2014-06-15 07:46:08,112 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testMultipleDeleteFamilyVersionWithDiffLabels is still present, removing 2014-06-15 07:46:08,112 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testMultipleDeleteFamilyVersionWithDiffLabels is still present, removing 2014-06-15 07:46:08,112 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,113 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,113 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' with timeout 60000ms 2014-06-15 07:46:08,113 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' with timeout 60000ms 2014-06-15 07:46:08,113 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:08,113 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:08,113 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'acquire' stage 2014-06-15 07:46:08,113 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'acquire' stage 2014-06-15 07:46:08,113 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally acquired 2014-06-15 07:46:08,113 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally acquired 2014-06-15 07:46:08,114 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testMultipleDeleteFamilyVersionWithDiffLabels) in zk 2014-06-15 07:46:08,114 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testMultipleDeleteFamilyVersionWithDiffLabels) in zk 2014-06-15 07:46:08,116 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,116 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,118 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,118 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:08,119 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,119 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:08,119 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:08,119 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:08,119 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:08,119 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. started... 2014-06-15 07:46:08,119 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] regionserver.HRegion(1696): Started memstore flush for testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60., current region memstore size 400 B 2014-06-15 07:46:08,179 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:08,181 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741892_1068 size 5220 2014-06-15 07:46:08,182 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=20, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/.tmp/a87728950d7b49038d4f83cfc4c350cc 2014-06-15 07:46:08,190 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a87728950d7b49038d4f83cfc4c350cc 2014-06-15 07:46:08,191 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/.tmp/a87728950d7b49038d4f83cfc4c350cc as hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/info/a87728950d7b49038d4f83cfc4c350cc 2014-06-15 07:46:08,207 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a87728950d7b49038d4f83cfc4c350cc 2014-06-15 07:46:08,207 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testMultipleDeleteFamilyVersionWithDiffLabels/da04879e5c51927a3089f81497b31a60/info/a87728950d7b49038d4f83cfc4c350cc, entries=3, sequenceid=20, filesize=5.1 K 2014-06-15 07:46:08,208 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~400 B/400, currentsize=0 B/0 for region testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. in 89ms, sequenceid=20, compaction requested=false 2014-06-15 07:46:08,208 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool90-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:08,208 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:08,208 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:08,208 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,208 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally acquired 2014-06-15 07:46:08,208 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testMultipleDeleteFamilyVersionWithDiffLabels) in zk 2014-06-15 07:46:08,211 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,211 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,211 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,211 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,211 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,212 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:08,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:08,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:08,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:08,213 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,213 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:08,213 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,213 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:08,215 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:08,215 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:08,215 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' on coordinator 2014-06-15 07:46:08,215 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@11cc198[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:08,215 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' starting 'in-barrier' execution. 2014-06-15 07:46:08,216 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,218 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,218 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,218 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,218 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,218 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,218 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,218 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' received 'reached' from coordinator. 2014-06-15 07:46:08,219 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' received 'reached' from coordinator. 2014-06-15 07:46:08,219 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally completed 2014-06-15 07:46:08,219 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,219 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:08,219 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally completed 2014-06-15 07:46:08,218 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,219 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:08,219 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,219 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,220 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,220 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' received 'reached' from coordinator. 2014-06-15 07:46:08,220 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:08,220 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' locally completed 2014-06-15 07:46:08,220 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:08,220 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:08,243 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' has notified controller of completion 2014-06-15 07:46:08,243 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:08,243 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:08,243 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed. 2014-06-15 07:46:08,247 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,248 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' has notified controller of completion 2014-06-15 07:46:08,248 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:08,248 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed. 2014-06-15 07:46:08,248 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' has notified controller of completion 2014-06-15 07:46:08,248 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:08,248 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:08,248 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testMultipleDeleteFamilyVersionWithDiffLabels' completed. 2014-06-15 07:46:08,251 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,251 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:08,251 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:08,251 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:08,252 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,252 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:08,252 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,253 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:08,253 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testMultipleDeleteFamilyVersionWithDiffLabels' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:08,253 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,253 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,253 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,253 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testMultipleDeleteFamilyVersionWithDiffLabels/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,254 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:08,254 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:08,254 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:08,254 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,254 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:08,255 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,255 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:08,255 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:08,255 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:08,256 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,256 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:08,256 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,256 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:08,258 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:08,258 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testMultipleDeleteFamilyVersionWithDiffLabels', counting down latch. Waiting for 0 more 2014-06-15 07:46:08,259 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testMultipleDeleteFamilyVersionWithDiffLabels' execution completed 2014-06-15 07:46:08,260 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:08,260 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:08,260 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testMultipleDeleteFamilyVersionWithDiffLabels 2014-06-15 07:46:08,260 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testMultipleDeleteFamilyVersionWithDiffLabelsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:08,271 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:08,271 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:08,271 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:08,271 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:08,272 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:08,271 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:08,272 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:08,272 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:08,272 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:08,279 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:08,279 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testMultipleDeleteFamilyVersionWithDiffLabels' 2014-06-15 07:46:08,279 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:08,279 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testMultipleDeleteFamilyVersionWithDiffLabels'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:08,280 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:08,380 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:08,381 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:08,382 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0056, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:08,413 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testMultipleDeleteFamilyVersionWithDiffLabels Thread=374 (was 374), OpenFileDescriptor=572 (was 575), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=546 (was 546), ProcessCount=176 (was 176), AvailableMemoryMB=3681 (was 3778), ConnectionCount=8 (was 8) 2014-06-15 07:46:08,434 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testScanAfterCompaction Thread=375, OpenFileDescriptor=574, MaxFileDescriptor=60000, SystemLoadAverage=546, ProcessCount=176, AvailableMemoryMB=3674, ConnectionCount=8 2014-06-15 07:46:08,467 DEBUG [RpcServer.handler=0,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:08,469 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:08,472 INFO [RpcServer.handler=2,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testScanAfterCompaction', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:08,477 DEBUG [RpcServer.handler=2,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testScanAfterCompaction/write-master:458120000000000 2014-06-15 07:46:08,481 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testScanAfterCompaction 2014-06-15 07:46:08,509 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:08,510 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:08,519 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testScanAfterCompaction/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:08,520 INFO [RegionOpenAndInitThread-testScanAfterCompaction-1] regionserver.HRegion(4277): creating HRegion testScanAfterCompaction HTD == 'testScanAfterCompaction', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testScanAfterCompaction 2014-06-15 07:46:08,557 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:08,558 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:08,561 DEBUG [RegionOpenAndInitThread-testScanAfterCompaction-1] regionserver.HRegion(646): Instantiated testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:08,561 DEBUG [RegionOpenAndInitThread-testScanAfterCompaction-1] regionserver.HRegion(1116): Closing testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5.: disabling compactions & flushes 2014-06-15 07:46:08,562 DEBUG [RegionOpenAndInitThread-testScanAfterCompaction-1] regionserver.HRegion(1143): Updates disabled for region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:08,562 INFO [RegionOpenAndInitThread-testScanAfterCompaction-1] regionserver.HRegion(1225): Closed testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:08,570 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:08,573 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,573 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 9f663b0e5149512e770bffee97447ec5 with OFFLINE state 2014-06-15 07:46:08,575 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:08,575 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={9f663b0e5149512e770bffee97447ec5 state=OFFLINE, ts=1402818368573, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,576 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={9f663b0e5149512e770bffee97447ec5 state=OFFLINE, ts=1402818368573, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,579 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:08,579 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {9f663b0e5149512e770bffee97447ec5 state=OFFLINE, ts=1402818368573, server=null} to {9f663b0e5149512e770bffee97447ec5 state=PENDING_OPEN, ts=1402818368579, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:08,580 INFO [Priority.RpcServer.handler=5,port=47197] regionserver.RSRpcServices(1230): Open testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:08,588 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,588 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testScanAfterCompaction state from ENABLING to ENABLED 2014-06-15 07:46:08,590 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 9f663b0e5149512e770bffee97447ec5 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:08,592 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 9f663b0e5149512e770bffee97447ec5 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:08,592 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/9f663b0e5149512e770bffee97447ec5 2014-06-15 07:46:08,592 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(4462): Opening region: {ENCODED => 9f663b0e5149512e770bffee97447ec5, NAME => 'testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:08,592 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(5559): Registered coprocessor service: region=testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. service=VisibilityLabelsService 2014-06-15 07:46:08,593 INFO [RS_OPEN_REGION-asf008:47197-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:08,593 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testScanAfterCompaction 9f663b0e5149512e770bffee97447ec5 2014-06-15 07:46:08,593 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(646): Instantiated testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:08,594 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testScanAfterCompaction/write-master:458120000000000 2014-06-15 07:46:08,595 DEBUG [AM.ZK.Worker-pool3-t20] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=9f663b0e5149512e770bffee97447ec5, current_state={9f663b0e5149512e770bffee97447ec5 state=PENDING_OPEN, ts=1402818368579, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:08,595 INFO [AM.ZK.Worker-pool3-t20] master.RegionStates(813): Transition {9f663b0e5149512e770bffee97447ec5 state=PENDING_OPEN, ts=1402818368579, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {9f663b0e5149512e770bffee97447ec5 state=OPENING, ts=1402818368595, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:08,604 INFO [StoreOpener-9f663b0e5149512e770bffee97447ec5-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:08,604 INFO [StoreOpener-9f663b0e5149512e770bffee97447ec5-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:08,607 DEBUG [StoreOpener-9f663b0e5149512e770bffee97447ec5-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info 2014-06-15 07:46:08,609 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5 2014-06-15 07:46:08,610 INFO [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(747): Onlined 9f663b0e5149512e770bffee97447ec5; next sequenceid=2 2014-06-15 07:46:08,610 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 9f663b0e5149512e770bffee97447ec5 2014-06-15 07:46:08,614 INFO [PostOpenDeployTasks:9f663b0e5149512e770bffee97447ec5] regionserver.HRegionServer(1663): Post open deploy tasks for testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:08,618 INFO [PostOpenDeployTasks:9f663b0e5149512e770bffee97447ec5] catalog.MetaEditor(464): Updated row testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,618 DEBUG [PostOpenDeployTasks:9f663b0e5149512e770bffee97447ec5] regionserver.HRegionServer(1693): Finished post open deploy task for testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:08,619 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 9f663b0e5149512e770bffee97447ec5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:08,622 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/9f663b0e5149512e770bffee97447ec5 2014-06-15 07:46:08,622 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 9f663b0e5149512e770bffee97447ec5 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:08,622 DEBUG [RS_OPEN_REGION-asf008:47197-2] coordination.ZkOpenRegionCoordination(91): Transitioned 9f663b0e5149512e770bffee97447ec5 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,622 DEBUG [RS_OPEN_REGION-asf008:47197-2] handler.OpenRegionHandler(167): Opened testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,623 DEBUG [AM.ZK.Worker-pool3-t3] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=9f663b0e5149512e770bffee97447ec5, current_state={9f663b0e5149512e770bffee97447ec5 state=OPENING, ts=1402818368595, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:08,623 INFO [AM.ZK.Worker-pool3-t3] master.RegionStates(813): Transition {9f663b0e5149512e770bffee97447ec5 state=OPENING, ts=1402818368595, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {9f663b0e5149512e770bffee97447ec5 state=OPEN, ts=1402818368623, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:08,623 DEBUG [AM.ZK.Worker-pool3-t3] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 9f663b0e5149512e770bffee97447ec5 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:08,624 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/9f663b0e5149512e770bffee97447ec5 2014-06-15 07:46:08,624 DEBUG [AM.ZK.Worker-pool3-t3] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 9f663b0e5149512e770bffee97447ec5 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:08,624 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:08,624 DEBUG [AM.ZK.Worker-pool3-t3] master.AssignmentManager$4(1293): Znode testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. deleted, state: {9f663b0e5149512e770bffee97447ec5 state=OPEN, ts=1402818368623, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:08,624 INFO [AM.ZK.Worker-pool3-t3] master.RegionStates(359): Onlined 9f663b0e5149512e770bffee97447ec5 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:08,803 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:08,803 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:08,814 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:08,814 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:08,815 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0058 connected 2014-06-15 07:46:08,821 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0058, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:08,847 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:08,847 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:08,876 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:08,876 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:08,877 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0059 connected 2014-06-15 07:46:08,893 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:08,894 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,058 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:09,060 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:09,060 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005a connected 2014-06-15 07:46:09,065 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,073 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:09,078 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testScanAfterCompaction' 2014-06-15 07:46:09,078 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,078 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testScanAfterCompaction' starting 'acquire' 2014-06-15 07:46:09,078 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testScanAfterCompaction', kicking off acquire phase on members. 2014-06-15 07:46:09,079 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,079 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,080 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,080 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,080 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,081 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,081 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,080 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,080 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,081 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,082 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,082 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,082 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:09,082 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,082 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,082 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,083 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,083 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,084 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,084 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,084 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,084 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,084 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,084 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,084 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,084 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,085 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,085 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,085 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,084 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,085 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,085 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:09,085 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool94-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:09,085 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:09,086 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool94-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. started... 2014-06-15 07:46:09,085 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,087 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool94-thread-1] regionserver.HRegion(1696): Started memstore flush for testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5., current region memstore size 712 B 2014-06-15 07:46:09,087 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,090 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,090 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,090 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,090 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,090 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,128 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:09,129 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741895_1071 size 5165 2014-06-15 07:46:09,133 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool94-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/c26c9744819c43b482de64c888fbcf3d 2014-06-15 07:46:09,141 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool94-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/c26c9744819c43b482de64c888fbcf3d as hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/c26c9744819c43b482de64c888fbcf3d 2014-06-15 07:46:09,152 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool94-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/c26c9744819c43b482de64c888fbcf3d, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:09,153 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool94-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. in 66ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:09,153 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool94-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:09,153 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:09,153 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:09,153 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,153 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,153 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,156 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,156 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,156 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,156 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,156 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,156 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,156 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,156 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,157 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,157 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,157 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,157 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,158 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,159 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,159 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,159 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,160 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testScanAfterCompaction' on coordinator 2014-06-15 07:46:09,160 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@e21a17[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:09,160 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testScanAfterCompaction' starting 'in-barrier' execution. 2014-06-15 07:46:09,160 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,161 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,161 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,161 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,162 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,162 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,162 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,162 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,162 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,162 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,162 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,161 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,162 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,163 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,163 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:09,163 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,162 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,163 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,162 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,163 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,163 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:09,164 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,164 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:09,165 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,165 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,166 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,166 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,166 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,166 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,166 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,166 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,166 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,166 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,166 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,166 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,167 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,167 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,167 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,168 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,168 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,168 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,168 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,169 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,169 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testScanAfterCompaction' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:09,169 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,169 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,169 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,170 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,170 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,170 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,170 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,170 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,171 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,171 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,171 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,171 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,172 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,172 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,172 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,172 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,173 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,173 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testScanAfterCompaction' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:09,173 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testScanAfterCompaction', counting down latch. Waiting for 0 more 2014-06-15 07:46:09,173 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testScanAfterCompaction' execution completed 2014-06-15 07:46:09,174 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:09,174 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:09,174 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testScanAfterCompaction 2014-06-15 07:46:09,174 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testScanAfterCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:09,181 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,181 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,181 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,181 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,181 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,181 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,182 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,181 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,182 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,189 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,189 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testScanAfterCompaction' 2014-06-15 07:46:09,189 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:09,190 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testScanAfterCompaction'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:09,190 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:09,290 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:09,292 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:09,292 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0059, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,373 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:09,373 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,375 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:09,375 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:09,376 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005b connected 2014-06-15 07:46:09,388 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:09,389 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,389 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:09,390 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:09,391 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005c connected 2014-06-15 07:46:09,395 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,398 INFO [RpcServer.handler=4,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:09,404 DEBUG [RpcServer.handler=4,port=45812] procedure.ProcedureCoordinator(158): Procedure testScanAfterCompaction was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:09,404 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testScanAfterCompaction' 2014-06-15 07:46:09,404 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,404 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testScanAfterCompaction' starting 'acquire' 2014-06-15 07:46:09,405 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testScanAfterCompaction', kicking off acquire phase on members. 2014-06-15 07:46:09,405 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,405 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,407 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,407 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,407 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,407 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,408 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,407 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,408 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,407 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,408 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,408 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,408 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,408 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,408 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,408 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:09,409 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,409 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,409 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,409 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,409 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,409 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,410 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,410 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,410 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,410 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,410 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testScanAfterCompaction is still present, removing 2014-06-15 07:46:09,410 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,410 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,411 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,411 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,411 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testScanAfterCompaction is still present, removing 2014-06-15 07:46:09,411 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,411 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,411 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,411 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,411 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,412 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,412 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,412 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,411 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,412 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:09,412 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:09,412 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testScanAfterCompaction is still present, removing 2014-06-15 07:46:09,412 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,413 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool97-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:09,413 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,413 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,413 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool97-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. started... 2014-06-15 07:46:09,413 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,413 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,413 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool97-thread-1] regionserver.HRegion(1696): Started memstore flush for testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5., current region memstore size 144 B 2014-06-15 07:46:09,413 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,415 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,415 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,415 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,416 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,417 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,417 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,442 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:09,444 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741896_1072 size 4956 2014-06-15 07:46:09,446 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool97-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/a704e2370b2341d7aeb6fa372c67e4df 2014-06-15 07:46:09,455 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool97-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/a704e2370b2341d7aeb6fa372c67e4df as hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a704e2370b2341d7aeb6fa372c67e4df 2014-06-15 07:46:09,470 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool97-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a704e2370b2341d7aeb6fa372c67e4df, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:46:09,471 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool97-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. in 58ms, sequenceid=16, compaction requested=false 2014-06-15 07:46:09,471 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool97-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:09,471 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:09,471 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:09,471 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,471 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,471 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,473 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,473 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,473 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,473 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,473 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,473 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,473 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,474 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,474 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,474 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,474 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,474 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,475 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,476 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testScanAfterCompaction' on coordinator 2014-06-15 07:46:09,476 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1a62c37[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:09,476 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testScanAfterCompaction' starting 'in-barrier' execution. 2014-06-15 07:46:09,476 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,477 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,477 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,477 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,477 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,478 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,478 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,478 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,478 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,478 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,478 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,478 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:09,478 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:09,478 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,479 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,479 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,479 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,479 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,479 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:09,479 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,505 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,505 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,506 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,506 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,508 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,508 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,508 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,508 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,508 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,509 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,509 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,509 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,510 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,510 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,510 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,510 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,511 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,511 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,511 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,512 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,512 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testScanAfterCompaction' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:09,512 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,512 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,514 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,514 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,514 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,514 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,515 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,515 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,515 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,516 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,516 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,516 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testScanAfterCompaction' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:09,516 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testScanAfterCompaction', counting down latch. Waiting for 0 more 2014-06-15 07:46:09,516 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testScanAfterCompaction' execution completed 2014-06-15 07:46:09,517 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:09,517 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:09,517 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testScanAfterCompaction 2014-06-15 07:46:09,517 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testScanAfterCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:09,523 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,523 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,523 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,523 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,523 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,523 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,523 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,524 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,524 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,528 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,528 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testScanAfterCompaction' 2014-06-15 07:46:09,528 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:09,529 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testScanAfterCompaction'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:09,529 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:09,629 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:09,630 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:09,631 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,639 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:09,640 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,642 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:09,642 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:09,643 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005d connected 2014-06-15 07:46:09,653 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:09,653 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,655 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:09,655 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:09,656 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005e connected 2014-06-15 07:46:09,659 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,662 INFO [RpcServer.handler=4,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:09,674 DEBUG [RpcServer.handler=4,port=45812] procedure.ProcedureCoordinator(158): Procedure testScanAfterCompaction was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:09,674 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testScanAfterCompaction' 2014-06-15 07:46:09,674 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,674 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testScanAfterCompaction' starting 'acquire' 2014-06-15 07:46:09,674 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testScanAfterCompaction', kicking off acquire phase on members. 2014-06-15 07:46:09,675 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,675 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,677 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,677 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,678 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,678 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,678 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,677 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,678 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,678 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,677 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,678 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,678 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,679 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,679 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,679 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:09,679 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,679 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,679 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,680 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,680 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,680 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,680 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,680 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,680 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,680 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,681 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,681 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,681 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,681 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testScanAfterCompaction is still present, removing 2014-06-15 07:46:09,681 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testScanAfterCompaction is still present, removing 2014-06-15 07:46:09,681 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,681 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,682 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,682 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testScanAfterCompaction is still present, removing 2014-06-15 07:46:09,682 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,682 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,682 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,682 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,682 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,682 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,683 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,683 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,683 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,683 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,683 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,683 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,683 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,683 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:09,684 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:09,684 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:09,684 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. started... 2014-06-15 07:46:09,684 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] regionserver.HRegion(1696): Started memstore flush for testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5., current region memstore size 136 B 2014-06-15 07:46:09,684 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,685 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,685 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,685 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,685 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,685 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,707 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:09,708 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:09,710 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=136, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/d4c76436f7a74992aff787bdfc02df9c 2014-06-15 07:46:09,719 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4c76436f7a74992aff787bdfc02df9c 2014-06-15 07:46:09,721 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/d4c76436f7a74992aff787bdfc02df9c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/d4c76436f7a74992aff787bdfc02df9c 2014-06-15 07:46:09,729 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4c76436f7a74992aff787bdfc02df9c 2014-06-15 07:46:09,729 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/d4c76436f7a74992aff787bdfc02df9c, entries=1, sequenceid=19, filesize=5.0 K 2014-06-15 07:46:09,730 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. in 46ms, sequenceid=19, compaction requested=true 2014-06-15 07:46:09,730 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool101-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:09,730 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:09,730 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:09,730 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,730 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,730 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,738 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,738 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,738 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,738 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,738 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,738 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,738 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,738 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,738 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,738 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,739 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,739 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,739 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,740 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,740 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,740 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,741 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testScanAfterCompaction' on coordinator 2014-06-15 07:46:09,741 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@17ceb9b[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:09,741 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testScanAfterCompaction' starting 'in-barrier' execution. 2014-06-15 07:46:09,741 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,742 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,742 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,742 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,742 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,742 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,743 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,743 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,743 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,743 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,743 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,743 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:09,743 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,743 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,743 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,744 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,743 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,744 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:09,744 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,744 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,744 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:09,744 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:09,745 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:09,745 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,747 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,747 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,747 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,747 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,747 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,748 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,748 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,806 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:09,806 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,806 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:09,806 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,807 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,807 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,808 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,808 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,809 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,809 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,809 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,810 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,811 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testScanAfterCompaction' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:09,811 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,811 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,811 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,811 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,811 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:09,811 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:09,811 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:09,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,812 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,813 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:09,813 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:09,813 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:09,813 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:09,814 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,814 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:09,815 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testScanAfterCompaction' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:09,815 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testScanAfterCompaction', counting down latch. Waiting for 0 more 2014-06-15 07:46:09,815 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testScanAfterCompaction' execution completed 2014-06-15 07:46:09,815 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:09,815 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:09,815 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testScanAfterCompaction 2014-06-15 07:46:09,815 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testScanAfterCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:09,821 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,821 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,821 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,821 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,821 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,821 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,821 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,821 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,822 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,829 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:09,830 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testScanAfterCompaction' 2014-06-15 07:46:09,830 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:09,830 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testScanAfterCompaction'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:09,830 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:09,930 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:09,932 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:09,932 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,938 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:09,939 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,940 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:09,940 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:09,941 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005f connected 2014-06-15 07:46:09,952 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:09,952 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,954 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:09,954 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:09,955 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0060 connected 2014-06-15 07:46:09,961 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0060, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:09,964 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:09,975 DEBUG [RpcServer.handler=1,port=45812] procedure.ProcedureCoordinator(158): Procedure testScanAfterCompaction was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:09,976 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testScanAfterCompaction' 2014-06-15 07:46:09,976 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,976 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testScanAfterCompaction' starting 'acquire' 2014-06-15 07:46:09,976 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testScanAfterCompaction', kicking off acquire phase on members. 2014-06-15 07:46:09,976 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,977 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,978 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,978 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,978 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,978 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:09,978 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,978 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,979 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:09,979 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:09,978 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:09,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:09,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,979 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScanAfterCompaction 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,980 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,981 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,981 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testScanAfterCompaction is still present, removing 2014-06-15 07:46:09,981 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:09,981 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,981 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testScanAfterCompaction 2014-06-15 07:46:09,981 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,981 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testScanAfterCompaction 2014-06-15 07:46:09,981 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,981 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,982 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,982 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testScanAfterCompaction 2014-06-15 07:46:09,982 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,982 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testScanAfterCompaction' with timeout 60000ms 2014-06-15 07:46:09,982 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,982 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:09,982 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,982 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testScanAfterCompaction' starting 'acquire' stage 2014-06-15 07:46:09,983 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,983 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:09,983 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,983 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:09,982 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:09,983 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:09,983 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool102-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:09,984 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool102-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. started... 2014-06-15 07:46:09,984 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool102-thread-1] regionserver.HRegion(1696): Started memstore flush for testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5., current region memstore size 144 B 2014-06-15 07:46:09,984 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,985 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,985 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,985 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:09,985 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:09,986 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:10,003 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:10,003 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741898_1074 size 4951 2014-06-15 07:46:10,005 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool102-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=22, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/a7e02c32f71242a2b378c4271ed55fee 2014-06-15 07:46:10,013 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool102-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/a7e02c32f71242a2b378c4271ed55fee as hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a7e02c32f71242a2b378c4271ed55fee 2014-06-15 07:46:10,022 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool102-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a7e02c32f71242a2b378c4271ed55fee, entries=1, sequenceid=22, filesize=4.8 K 2014-06-15 07:46:10,023 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool102-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. in 39ms, sequenceid=22, compaction requested=true 2014-06-15 07:46:10,023 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool102-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:10,023 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:10,023 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:10,023 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,023 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testScanAfterCompaction' locally acquired 2014-06-15 07:46:10,023 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testScanAfterCompaction) in zk 2014-06-15 07:46:10,026 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,026 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,026 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,026 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,026 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,026 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testScanAfterCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:10,026 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:10,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:10,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:10,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:10,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:10,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:10,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:10,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:10,029 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testScanAfterCompaction' on coordinator 2014-06-15 07:46:10,029 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@16cb515[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:10,029 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testScanAfterCompaction' starting 'in-barrier' execution. 2014-06-15 07:46:10,029 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,030 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,030 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,030 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,031 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,031 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,030 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,031 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:10,031 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,031 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:10,031 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:10,031 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:10,031 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:10,030 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,031 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:10,032 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,032 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,032 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testScanAfterCompaction' received 'reached' from coordinator. 2014-06-15 07:46:10,031 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testScanAfterCompaction 2014-06-15 07:46:10,032 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testScanAfterCompaction' locally completed 2014-06-15 07:46:10,032 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:10,033 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testScanAfterCompaction' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:10,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:10,034 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:10,034 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:10,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:10,034 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:10,035 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:10,035 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testScanAfterCompaction' has notified controller of completion 2014-06-15 07:46:10,035 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:10,035 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:10,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:10,035 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:10,035 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testScanAfterCompaction' completed. 2014-06-15 07:46:10,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:10,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:10,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:10,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:10,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:10,038 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:10,038 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:10,038 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,039 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testScanAfterCompaction' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:10,039 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,039 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,039 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,039 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testScanAfterCompaction/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,039 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:10,039 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:10,040 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:10,040 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:10,040 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:10,040 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,041 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:10,041 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:10,042 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:10,042 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testScanAfterCompaction 2014-06-15 07:46:10,042 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:10,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:10,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:10,044 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testScanAfterCompaction' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:10,044 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testScanAfterCompaction', counting down latch. Waiting for 0 more 2014-06-15 07:46:10,044 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testScanAfterCompaction' execution completed 2014-06-15 07:46:10,044 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:10,044 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:10,044 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testScanAfterCompaction 2014-06-15 07:46:10,044 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testScanAfterCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:10,049 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:10,049 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:10,049 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:10,050 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:10,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:10,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:10,049 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:10,050 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:10,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:10,054 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:10,054 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testScanAfterCompaction' 2014-06-15 07:46:10,055 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:10,055 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testScanAfterCompaction'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:10,055 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:10,155 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:10,157 DEBUG [RpcServer.handler=2,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:10,157 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a005f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:10,162 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:10,162 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:10,164 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:10,164 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:10,165 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0061 connected 2014-06-15 07:46:10,183 INFO [Priority.RpcServer.handler=6,port=47197] regionserver.RSRpcServices(939): Compacting testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:10,183 DEBUG [Priority.RpcServer.handler=6,port=47197] compactions.RatioBasedCompactionPolicy(92): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 10 blocking 2014-06-15 07:46:10,184 DEBUG [Priority.RpcServer.handler=6,port=47197] compactions.ExploringCompactionPolicy(122): Exploring compaction algorithm has selected 4 files of size 20196 starting at candidate #0 after considering 3 permutations with 3 in ratio 2014-06-15 07:46:10,184 DEBUG [Priority.RpcServer.handler=6,port=47197] regionserver.HStore(1420): 9f663b0e5149512e770bffee97447ec5 - info: Initiating minor compaction (all files) 2014-06-15 07:46:10,185 DEBUG [Priority.RpcServer.handler=6,port=47197] regionserver.CompactSplitThread(319): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1a6f572; Because: User-triggered compaction; compaction_queue=(0:0), split_queue=0, merge_queue=0 2014-06-15 07:46:10,185 INFO [RS:1;asf008:47197-shortCompactions-1402818370184] regionserver.HRegion(1490): Starting compaction on info in region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:10,186 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0061, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:10,187 INFO [RS:1;asf008:47197-shortCompactions-1402818370184] regionserver.HStore(1074): Starting compaction of 4 file(s) in info of testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. into tmpdir=hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp, totalSize=19.7 K 2014-06-15 07:46:10,187 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] compactions.Compactor(145): Compacting hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/c26c9744819c43b482de64c888fbcf3d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, seqNum=13, earliestPutTs=123 2014-06-15 07:46:10,187 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] compactions.Compactor(145): Compacting hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a704e2370b2341d7aeb6fa372c67e4df, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, seqNum=16, earliestPutTs=127 2014-06-15 07:46:10,187 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] compactions.Compactor(145): Compacting hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/d4c76436f7a74992aff787bdfc02df9c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, seqNum=19, earliestPutTs=9223372036854775807 2014-06-15 07:46:10,187 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] compactions.Compactor(145): Compacting hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a7e02c32f71242a2b378c4271ed55fee, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, seqNum=22, earliestPutTs=127 2014-06-15 07:46:10,197 INFO [RS:1;asf008:47197-shortCompactions-1402818370184] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:10,213 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:10,214 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:10,227 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/.tmp/6a45d3e9dd204776b8fbf4aaa4e09ec1 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/6a45d3e9dd204776b8fbf4aaa4e09ec1 2014-06-15 07:46:10,241 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] regionserver.HStore(1530): Removing store files after compaction... 2014-06-15 07:46:10,251 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/c26c9744819c43b482de64c888fbcf3d, to hdfs://localhost:37161/user/jenkins/hbase/archive/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/c26c9744819c43b482de64c888fbcf3d 2014-06-15 07:46:10,254 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a704e2370b2341d7aeb6fa372c67e4df, to hdfs://localhost:37161/user/jenkins/hbase/archive/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a704e2370b2341d7aeb6fa372c67e4df 2014-06-15 07:46:10,259 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/d4c76436f7a74992aff787bdfc02df9c, to hdfs://localhost:37161/user/jenkins/hbase/archive/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/d4c76436f7a74992aff787bdfc02df9c 2014-06-15 07:46:10,262 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] backup.HFileArchiver(438): Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://localhost:37161/user/jenkins/hbase/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a7e02c32f71242a2b378c4271ed55fee, to hdfs://localhost:37161/user/jenkins/hbase/archive/data/default/testScanAfterCompaction/9f663b0e5149512e770bffee97447ec5/info/a7e02c32f71242a2b378c4271ed55fee 2014-06-15 07:46:10,262 INFO [RS:1;asf008:47197-shortCompactions-1402818370184] regionserver.HStore(1196): Completed compaction of 4 (all) file(s) in info of testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. into 6a45d3e9dd204776b8fbf4aaa4e09ec1(size=5.0 K), total size for store is 5.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2014-06-15 07:46:10,262 INFO [RS:1;asf008:47197-shortCompactions-1402818370184] regionserver.CompactSplitThread$CompactionRunner(477): Completed compaction: Request = regionName=testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5., storeName=info, fileCount=4, fileSize=19.7 K, priority=1, time=3780442250981022; duration=0sec 2014-06-15 07:46:10,265 DEBUG [RS:1;asf008:47197-shortCompactions-1402818370184] regionserver.CompactSplitThread$CompactionRunner(499): CompactSplitThread Status: compaction_queue=(0:0), split_queue=0, merge_queue=0 2014-06-15 07:46:15,216 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testScanAfterCompaction Thread=369 (was 375), OpenFileDescriptor=560 (was 574), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 546) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 176), AvailableMemoryMB=2768 (was 3674), ConnectionCount=8 (was 8) 2014-06-15 07:46:15,239 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnWithLatestTimeStampWhenNoVersionMatches Thread=369, OpenFileDescriptor=562, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=176, AvailableMemoryMB=2768, ConnectionCount=8 2014-06-15 07:46:15,268 DEBUG [RpcServer.handler=3,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:15,269 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:15,274 INFO [RpcServer.handler=3,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:15,279 DEBUG [RpcServer.handler=3,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/write-master:458120000000000 2014-06-15 07:46:15,298 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,315 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:15,315 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:15,323 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:15,325 INFO [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampWhenNoVersionMatches-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnWithLatestTimeStampWhenNoVersionMatches HTD == 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,341 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:15,342 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741901_1077 size 88 2014-06-15 07:46:15,344 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampWhenNoVersionMatches-1] regionserver.HRegion(646): Instantiated testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,344 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampWhenNoVersionMatches-1] regionserver.HRegion(1116): Closing testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62.: disabling compactions & flushes 2014-06-15 07:46:15,344 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampWhenNoVersionMatches-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,344 INFO [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampWhenNoVersionMatches-1] regionserver.HRegion(1225): Closed testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,349 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:15,350 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,350 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node aadcdfde6ef8717dd8e86a135f880e62 with OFFLINE state 2014-06-15 07:46:15,351 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:15,352 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={aadcdfde6ef8717dd8e86a135f880e62 state=OFFLINE, ts=1402818375350, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,352 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={aadcdfde6ef8717dd8e86a135f880e62 state=OFFLINE, ts=1402818375350, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,355 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:15,355 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {aadcdfde6ef8717dd8e86a135f880e62 state=OFFLINE, ts=1402818375350, server=null} to {aadcdfde6ef8717dd8e86a135f880e62 state=PENDING_OPEN, ts=1402818375355, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:15,356 INFO [Priority.RpcServer.handler=7,port=47197] regionserver.RSRpcServices(1230): Open testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,361 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning aadcdfde6ef8717dd8e86a135f880e62 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:15,361 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,361 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnWithLatestTimeStampWhenNoVersionMatches state from ENABLING to ENABLED 2014-06-15 07:46:15,362 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/aadcdfde6ef8717dd8e86a135f880e62 2014-06-15 07:46:15,362 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node aadcdfde6ef8717dd8e86a135f880e62 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:15,363 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(4462): Opening region: {ENCODED => aadcdfde6ef8717dd8e86a135f880e62, NAME => 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:15,363 DEBUG [AM.ZK.Worker-pool3-t5] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=aadcdfde6ef8717dd8e86a135f880e62, current_state={aadcdfde6ef8717dd8e86a135f880e62 state=PENDING_OPEN, ts=1402818375355, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:15,363 INFO [AM.ZK.Worker-pool3-t5] master.RegionStates(813): Transition {aadcdfde6ef8717dd8e86a135f880e62 state=PENDING_OPEN, ts=1402818375355, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {aadcdfde6ef8717dd8e86a135f880e62 state=OPENING, ts=1402818375363, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:15,363 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. service=VisibilityLabelsService 2014-06-15 07:46:15,364 INFO [RS_OPEN_REGION-asf008:47197-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:15,364 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnWithLatestTimeStampWhenNoVersionMatches aadcdfde6ef8717dd8e86a135f880e62 2014-06-15 07:46:15,364 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(646): Instantiated testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,365 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/write-master:458120000000000 2014-06-15 07:46:15,369 INFO [StoreOpener-aadcdfde6ef8717dd8e86a135f880e62-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:15,370 INFO [StoreOpener-aadcdfde6ef8717dd8e86a135f880e62-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:15,371 DEBUG [StoreOpener-aadcdfde6ef8717dd8e86a135f880e62-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info 2014-06-15 07:46:15,372 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62 2014-06-15 07:46:15,373 INFO [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(747): Onlined aadcdfde6ef8717dd8e86a135f880e62; next sequenceid=2 2014-06-15 07:46:15,373 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node aadcdfde6ef8717dd8e86a135f880e62 2014-06-15 07:46:15,374 INFO [PostOpenDeployTasks:aadcdfde6ef8717dd8e86a135f880e62] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,377 INFO [PostOpenDeployTasks:aadcdfde6ef8717dd8e86a135f880e62] catalog.MetaEditor(464): Updated row testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,377 DEBUG [PostOpenDeployTasks:aadcdfde6ef8717dd8e86a135f880e62] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,378 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning aadcdfde6ef8717dd8e86a135f880e62 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:15,379 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/aadcdfde6ef8717dd8e86a135f880e62 2014-06-15 07:46:15,379 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node aadcdfde6ef8717dd8e86a135f880e62 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:15,379 DEBUG [RS_OPEN_REGION-asf008:47197-0] coordination.ZkOpenRegionCoordination(91): Transitioned aadcdfde6ef8717dd8e86a135f880e62 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,380 DEBUG [RS_OPEN_REGION-asf008:47197-0] handler.OpenRegionHandler(167): Opened testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,380 DEBUG [AM.ZK.Worker-pool3-t8] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=aadcdfde6ef8717dd8e86a135f880e62, current_state={aadcdfde6ef8717dd8e86a135f880e62 state=OPENING, ts=1402818375363, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:15,380 INFO [AM.ZK.Worker-pool3-t8] master.RegionStates(813): Transition {aadcdfde6ef8717dd8e86a135f880e62 state=OPENING, ts=1402818375363, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {aadcdfde6ef8717dd8e86a135f880e62 state=OPEN, ts=1402818375380, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:15,380 DEBUG [AM.ZK.Worker-pool3-t8] coordination.ZkOpenRegionCoordination(350): Handling OPENED of aadcdfde6ef8717dd8e86a135f880e62 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:15,382 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/aadcdfde6ef8717dd8e86a135f880e62 2014-06-15 07:46:15,382 DEBUG [AM.ZK.Worker-pool3-t8] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node aadcdfde6ef8717dd8e86a135f880e62 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:15,383 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:15,383 DEBUG [AM.ZK.Worker-pool3-t8] master.AssignmentManager$4(1293): Znode testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. deleted, state: {aadcdfde6ef8717dd8e86a135f880e62 state=OPEN, ts=1402818375380, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:15,383 INFO [AM.ZK.Worker-pool3-t8] master.RegionStates(359): Onlined aadcdfde6ef8717dd8e86a135f880e62 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,408 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:15,408 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,410 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:15,410 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:15,411 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0062 connected 2014-06-15 07:46:15,414 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0062, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,429 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:15,429 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,431 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:15,431 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:15,432 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0063 connected 2014-06-15 07:46:15,443 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:15,443 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,445 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:15,445 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:15,446 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0064 connected 2014-06-15 07:46:15,449 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0064, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,452 INFO [RpcServer.handler=4,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:15,456 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' 2014-06-15 07:46:15,457 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,457 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' 2014-06-15 07:46:15,457 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', kicking off acquire phase on members. 2014-06-15 07:46:15,457 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,457 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,460 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,460 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,460 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,460 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,460 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,460 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,460 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,460 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,461 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,461 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,461 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:15,461 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,461 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,461 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,461 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,461 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,462 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,462 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,462 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,462 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,462 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,462 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,462 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,463 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,463 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,463 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,464 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:15,464 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:15,464 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,462 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,464 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,464 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,464 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,465 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:15,465 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool106-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,465 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:15,465 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,465 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool106-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. started... 2014-06-15 07:46:15,465 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool106-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62., current region memstore size 712 B 2014-06-15 07:46:15,467 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,467 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,467 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,467 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,467 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,467 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,467 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,467 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:15,468 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,468 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,468 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:15,468 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:15,469 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,470 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,470 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:15,484 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:15,484 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:15,488 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool106-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/.tmp/c99ffa89ca1e4c298312645dad770673 2014-06-15 07:46:15,497 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool106-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/.tmp/c99ffa89ca1e4c298312645dad770673 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info/c99ffa89ca1e4c298312645dad770673 2014-06-15 07:46:15,507 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool106-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info/c99ffa89ca1e4c298312645dad770673, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:15,507 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool106-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. in 42ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:15,507 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool106-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,507 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:15,507 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:15,508 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,508 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:15,508 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:15,510 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,510 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,510 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,510 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,511 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,511 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:15,511 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:15,511 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,511 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:15,511 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:15,511 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,512 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,512 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,512 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:15,513 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:15,513 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' on coordinator 2014-06-15 07:46:15,514 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@19380c1[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:15,514 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'in-barrier' execution. 2014-06-15 07:46:15,514 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,516 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,516 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,516 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,516 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,516 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,517 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,517 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,517 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:15,517 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:15,516 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,517 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:15,517 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:15,517 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:15,518 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:15,517 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,518 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,518 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,518 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:15,518 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:15,518 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:15,518 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:15,519 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:15,520 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:15,520 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:15,521 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:15,521 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:15,522 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:15,522 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:15,522 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:15,522 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:15,522 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,523 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:15,523 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:15,523 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,524 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,525 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,525 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:15,526 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:15,526 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,526 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,526 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,527 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,528 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:15,528 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,528 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,528 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,528 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,528 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:15,528 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:15,528 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:15,529 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,529 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,529 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,529 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,530 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:15,530 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:15,530 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,531 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,531 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,531 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,532 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:15,532 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', counting down latch. Waiting for 0 more 2014-06-15 07:46:15,532 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' execution completed 2014-06-15 07:46:15,532 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:15,532 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:15,532 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,532 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampWhenNoVersionMatchesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:15,574 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,574 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,575 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,575 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,574 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,575 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,584 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:15,584 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' 2014-06-15 07:46:15,585 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:15,585 DEBUG [Thread-830] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampWhenNoVersionMatches'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:15,585 DEBUG [Thread-830] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:15,685 DEBUG [Thread-830] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:15,686 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:15,687 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0063, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,693 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:15,693 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,694 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:15,695 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:15,696 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0065 connected 2014-06-15 07:46:15,708 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:15,708 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,710 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:15,710 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:15,711 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0066 connected 2014-06-15 07:46:15,714 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0066, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,718 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:15,722 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithLatestTimeStampWhenNoVersionMatches was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:15,723 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' 2014-06-15 07:46:15,723 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,723 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' 2014-06-15 07:46:15,723 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', kicking off acquire phase on members. 2014-06-15 07:46:15,724 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,724 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,726 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,727 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,727 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,727 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,727 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,727 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,727 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,727 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,727 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,727 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,728 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,728 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,728 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,728 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:15,728 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,728 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,729 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,730 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:15,730 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,730 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,730 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,730 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,730 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,730 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:15,731 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,731 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,731 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:15,731 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,731 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:15,731 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,730 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:15,731 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,731 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,732 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:15,732 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,732 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:15,732 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,732 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,732 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:15,732 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool110-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,732 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:15,733 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool110-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. started... 2014-06-15 07:46:15,733 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool110-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62., current region memstore size 144 B 2014-06-15 07:46:15,735 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,736 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,736 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,736 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:15,736 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,736 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:15,749 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:15,750 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741903_1079 size 4956 2014-06-15 07:46:15,751 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool110-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/.tmp/639122a6f5404a6da169a5bb679d02b7 2014-06-15 07:46:15,759 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool110-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/.tmp/639122a6f5404a6da169a5bb679d02b7 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info/639122a6f5404a6da169a5bb679d02b7 2014-06-15 07:46:15,768 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool110-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info/639122a6f5404a6da169a5bb679d02b7, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:46:15,769 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool110-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. in 36ms, sequenceid=16, compaction requested=false 2014-06-15 07:46:15,769 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool110-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,769 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:15,769 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:15,769 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,769 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:15,769 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:15,771 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,771 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,771 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,771 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,771 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,772 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:15,772 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:15,772 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,772 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:15,772 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:15,772 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,773 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,773 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,774 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,774 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:15,774 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:15,775 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' on coordinator 2014-06-15 07:46:15,775 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@89f6ae[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:15,775 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'in-barrier' execution. 2014-06-15 07:46:15,775 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,777 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,777 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,777 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,777 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,777 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,777 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,777 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,778 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,778 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:15,777 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,778 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:15,778 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:15,778 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:15,778 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,778 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:15,779 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:15,778 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:15,778 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:15,779 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:15,778 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,779 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:15,779 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:15,779 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:15,780 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,782 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:15,782 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:15,782 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:15,782 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:15,782 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:15,783 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:15,783 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:15,782 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,782 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:15,783 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:15,783 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,784 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,784 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:15,784 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:15,785 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,785 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,785 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,786 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,786 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:15,786 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,786 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,786 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,786 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,787 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:15,787 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:15,787 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:15,787 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,788 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,788 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,788 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,788 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:15,789 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:15,789 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,789 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:15,790 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,790 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:15,790 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:15,791 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', counting down latch. Waiting for 0 more 2014-06-15 07:46:15,791 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' execution completed 2014-06-15 07:46:15,791 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:15,791 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:15,791 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,791 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampWhenNoVersionMatchesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:15,796 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,796 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,796 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,796 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,796 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,796 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,839 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:15,839 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' 2014-06-15 07:46:15,839 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:15,840 DEBUG [Thread-830] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampWhenNoVersionMatches'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:15,840 DEBUG [Thread-830] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:15,940 DEBUG [Thread-830] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:15,941 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:15,942 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0065, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,959 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:15,959 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,962 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:15,962 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:15,963 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0067 connected 2014-06-15 07:46:15,974 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:15,975 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,978 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:15,978 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:15,979 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0068 connected 2014-06-15 07:46:15,983 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0068, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:15,986 INFO [RpcServer.handler=4,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:15,990 DEBUG [RpcServer.handler=4,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithLatestTimeStampWhenNoVersionMatches was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:15,990 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' 2014-06-15 07:46:15,991 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,991 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' 2014-06-15 07:46:15,991 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', kicking off acquire phase on members. 2014-06-15 07:46:15,991 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,991 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,994 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,994 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,994 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,994 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,994 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,994 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:15,994 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:15,994 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,994 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:15,994 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,995 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,994 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:15,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:15,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,995 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,996 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,996 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:15,996 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,996 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,996 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:15,996 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,997 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,997 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,997 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:15,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,997 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:15,997 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,997 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:15,997 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,998 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:15,998 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,998 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,998 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,998 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:15,998 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,998 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:15,998 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,998 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:15,998 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:15,999 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:15,999 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:15,999 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:15,999 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:15,999 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:15,999 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool113-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:15,999 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool113-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. started... 2014-06-15 07:46:16,000 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool113-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62., current region memstore size 272 B 2014-06-15 07:46:16,002 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,002 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,002 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:16,013 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:16,013 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:16,016 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool113-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=21, memsize=272, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/.tmp/2c8b3fafe5cb4b05bf8ef75b3d42e520 2014-06-15 07:46:16,024 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool113-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/.tmp/2c8b3fafe5cb4b05bf8ef75b3d42e520 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info/2c8b3fafe5cb4b05bf8ef75b3d42e520 2014-06-15 07:46:16,037 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool113-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info/2c8b3fafe5cb4b05bf8ef75b3d42e520, entries=1, sequenceid=21, filesize=4.8 K 2014-06-15 07:46:16,037 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool113-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~272 B/272, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. in 37ms, sequenceid=21, compaction requested=true 2014-06-15 07:46:16,038 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool113-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:16,038 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:16,038 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:16,038 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,038 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:16,038 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:16,040 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,040 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,040 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,041 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,041 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,041 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:16,041 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:16,041 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,041 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:16,041 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:16,042 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,042 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,043 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:16,044 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:16,044 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' on coordinator 2014-06-15 07:46:16,044 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@f579de[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:16,044 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'in-barrier' execution. 2014-06-15 07:46:16,045 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,046 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,046 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,046 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,046 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,046 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,047 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:16,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:16,047 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:16,046 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,047 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:16,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:16,047 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:16,048 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:16,046 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,048 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:16,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,048 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:16,048 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:16,048 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:16,048 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:16,049 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:16,049 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:16,049 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:16,050 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,050 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:16,050 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:16,050 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:16,051 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:16,051 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:16,051 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,051 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:16,051 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,051 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:16,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:16,052 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,053 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,053 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,053 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,054 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:16,054 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,055 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:16,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:16,055 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:16,056 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,056 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,056 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,057 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,057 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:16,057 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:16,058 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,058 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,058 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,058 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,059 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:16,059 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', counting down latch. Waiting for 0 more 2014-06-15 07:46:16,059 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' execution completed 2014-06-15 07:46:16,059 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:16,059 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:16,059 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,060 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampWhenNoVersionMatchesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:16,065 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,066 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,065 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,066 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,066 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,066 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,066 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,066 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,066 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,072 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:16,072 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' 2014-06-15 07:46:16,072 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:16,072 DEBUG [Thread-830] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampWhenNoVersionMatches'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:16,073 DEBUG [Thread-830] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:16,173 DEBUG [Thread-830] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:16,174 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:16,174 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0067, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:16,372 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:16,373 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:16,384 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:16,385 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:16,386 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0069 connected 2014-06-15 07:46:16,400 INFO [Thread-830] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:16,401 DEBUG [Thread-830] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:16,405 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:16,405 DEBUG [Thread-830] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:16,406 DEBUG [Thread-830-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006a connected 2014-06-15 07:46:16,411 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:16,419 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:16,424 DEBUG [RpcServer.handler=1,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithLatestTimeStampWhenNoVersionMatches was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:16,425 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' 2014-06-15 07:46:16,425 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:16,425 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' 2014-06-15 07:46:16,425 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', kicking off acquire phase on members. 2014-06-15 07:46:16,426 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,426 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,428 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,428 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,428 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,429 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,428 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,429 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,428 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,429 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,428 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,429 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,429 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,430 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,430 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,430 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:16,430 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,430 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:16,430 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,430 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,431 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:16,431 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,431 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,431 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,431 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,431 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:16,431 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:16,432 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:16,432 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,432 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:16,432 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,432 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:16,432 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:16,432 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:16,433 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:16,433 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,433 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,433 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,433 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:16,433 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:16,433 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:16,434 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampWhenNoVersionMatches is still present, removing 2014-06-15 07:46:16,434 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:16,434 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,434 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:16,434 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' with timeout 60000ms 2014-06-15 07:46:16,434 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool115-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:16,434 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:16,435 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool115-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. started... 2014-06-15 07:46:16,435 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'acquire' stage 2014-06-15 07:46:16,435 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:16,435 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool115-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62., current region memstore size 136 B 2014-06-15 07:46:16,435 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:16,435 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,436 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,436 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:16,546 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,547 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,547 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:16,553 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:16,555 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:16,560 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool115-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=24, memsize=136, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/.tmp/8b15997299354ae18d7d43e85eaf2918 2014-06-15 07:46:16,581 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool115-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/.tmp/8b15997299354ae18d7d43e85eaf2918 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info/8b15997299354ae18d7d43e85eaf2918 2014-06-15 07:46:16,599 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool115-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/aadcdfde6ef8717dd8e86a135f880e62/info/8b15997299354ae18d7d43e85eaf2918, entries=1, sequenceid=24, filesize=4.8 K 2014-06-15 07:46:16,599 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool115-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. in 164ms, sequenceid=24, compaction requested=true 2014-06-15 07:46:16,599 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool115-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:16,599 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:16,600 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:16,600 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,600 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally acquired 2014-06-15 07:46:16,600 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampWhenNoVersionMatches) in zk 2014-06-15 07:46:16,603 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,603 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,603 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,603 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,603 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:16,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:16,604 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:16,605 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:16,605 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,605 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,606 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,606 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,606 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:16,606 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:16,607 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' on coordinator 2014-06-15 07:46:16,607 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1d95eb2[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:16,607 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' starting 'in-barrier' execution. 2014-06-15 07:46:16,607 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,608 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,609 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,609 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,609 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,609 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,609 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,609 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:16,609 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,609 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:16,609 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,609 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:16,610 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:16,610 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:16,610 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:16,610 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:16,610 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:16,610 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,610 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:16,610 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' received 'reached' from coordinator. 2014-06-15 07:46:16,610 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' locally completed 2014-06-15 07:46:16,611 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:16,611 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,612 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:16,612 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,612 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:16,612 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:16,613 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:16,613 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:16,613 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:16,613 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' has notified controller of completion 2014-06-15 07:46:16,614 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,614 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:16,614 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' completed. 2014-06-15 07:46:16,614 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,614 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:16,614 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:16,615 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,615 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,615 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,616 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,617 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:16,617 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,617 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,617 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,617 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampWhenNoVersionMatches/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,617 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:16,617 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:16,617 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:16,617 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,618 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,618 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,618 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,619 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:16,619 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:16,619 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,619 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:16,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:16,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:16,620 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches', counting down latch. Waiting for 0 more 2014-06-15 07:46:16,620 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' execution completed 2014-06-15 07:46:16,621 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:16,621 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:16,621 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampWhenNoVersionMatches 2014-06-15 07:46:16,621 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampWhenNoVersionMatchesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:16,630 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,630 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,630 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:16,631 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,631 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,630 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,631 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,631 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:16,631 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:16,640 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:16,640 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampWhenNoVersionMatches' 2014-06-15 07:46:16,640 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:16,640 DEBUG [Thread-830] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampWhenNoVersionMatches'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:16,640 DEBUG [Thread-830] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:16,741 DEBUG [Thread-830] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:16,742 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:16,742 DEBUG [Thread-830] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0069, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:16,793 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnWithLatestTimeStampWhenNoVersionMatches Thread=375 (was 369) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-196598018_8 at /127.0.0.1:36374 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:40332 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:40303 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:40321 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: Thread-830-SendThread(localhost:53967) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230) org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1185) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1122) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-586281474_8 at /127.0.0.1:36315 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=576 (was 562) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 562), ProcessCount=176 (was 176), AvailableMemoryMB=2740 (was 2768), ConnectionCount=8 (was 8) 2014-06-15 07:46:16,817 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilySpecificTimeStampWithMulipleVersions Thread=376, OpenFileDescriptor=578, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=176, AvailableMemoryMB=2739, ConnectionCount=8 2014-06-15 07:46:16,909 DEBUG [RpcServer.handler=4,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:16,911 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:16,914 INFO [RpcServer.handler=1,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteFamilySpecificTimeStampWithMulipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:16,921 DEBUG [RpcServer.handler=1,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteFamilySpecificTimeStampWithMulipleVersions/write-master:458120000000000 2014-06-15 07:46:16,926 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:16,940 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:16,941 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:16,952 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:16,954 INFO [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersions-1] regionserver.HRegion(4277): creating HRegion testDeleteFamilySpecificTimeStampWithMulipleVersions HTD == 'testDeleteFamilySpecificTimeStampWithMulipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:16,970 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:16,971 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741907_1083 size 85 2014-06-15 07:46:16,975 DEBUG [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersions-1] regionserver.HRegion(646): Instantiated testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:16,975 DEBUG [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersions-1] regionserver.HRegion(1116): Closing testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09.: disabling compactions & flushes 2014-06-15 07:46:16,975 DEBUG [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersions-1] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:16,975 INFO [RegionOpenAndInitThread-testDeleteFamilySpecificTimeStampWithMulipleVersions-1] regionserver.HRegion(1225): Closed testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:16,981 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:16,982 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,982 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node a2b01ee534860115f9a4019eda29af09 with OFFLINE state 2014-06-15 07:46:16,985 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:16,985 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={a2b01ee534860115f9a4019eda29af09 state=OFFLINE, ts=1402818376982, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,985 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={a2b01ee534860115f9a4019eda29af09 state=OFFLINE, ts=1402818376982, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,988 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:16,988 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {a2b01ee534860115f9a4019eda29af09 state=OFFLINE, ts=1402818376982, server=null} to {a2b01ee534860115f9a4019eda29af09 state=PENDING_OPEN, ts=1402818376988, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:16,988 INFO [Priority.RpcServer.handler=0,port=57332] regionserver.RSRpcServices(1230): Open testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:16,993 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning a2b01ee534860115f9a4019eda29af09 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:16,994 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:16,994 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteFamilySpecificTimeStampWithMulipleVersions state from ENABLING to ENABLED 2014-06-15 07:46:17,025 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a2b01ee534860115f9a4019eda29af09 2014-06-15 07:46:17,025 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node a2b01ee534860115f9a4019eda29af09 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:17,025 DEBUG [AM.ZK.Worker-pool3-t10] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=a2b01ee534860115f9a4019eda29af09, current_state={a2b01ee534860115f9a4019eda29af09 state=PENDING_OPEN, ts=1402818376988, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:17,025 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(4462): Opening region: {ENCODED => a2b01ee534860115f9a4019eda29af09, NAME => 'testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:17,025 INFO [AM.ZK.Worker-pool3-t10] master.RegionStates(813): Transition {a2b01ee534860115f9a4019eda29af09 state=PENDING_OPEN, ts=1402818376988, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {a2b01ee534860115f9a4019eda29af09 state=OPENING, ts=1402818377025, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:17,026 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. service=VisibilityLabelsService 2014-06-15 07:46:17,026 INFO [RS_OPEN_REGION-asf008:57332-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:17,026 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteFamilySpecificTimeStampWithMulipleVersions/write-master:458120000000000 2014-06-15 07:46:17,026 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteFamilySpecificTimeStampWithMulipleVersions a2b01ee534860115f9a4019eda29af09 2014-06-15 07:46:17,026 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(646): Instantiated testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,032 INFO [StoreOpener-a2b01ee534860115f9a4019eda29af09-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:17,032 INFO [StoreOpener-a2b01ee534860115f9a4019eda29af09-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:17,033 DEBUG [StoreOpener-a2b01ee534860115f9a4019eda29af09-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/info 2014-06-15 07:46:17,034 DEBUG [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09 2014-06-15 07:46:17,035 INFO [RS_OPEN_REGION-asf008:57332-0] regionserver.HRegion(747): Onlined a2b01ee534860115f9a4019eda29af09; next sequenceid=2 2014-06-15 07:46:17,036 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node a2b01ee534860115f9a4019eda29af09 2014-06-15 07:46:17,036 INFO [PostOpenDeployTasks:a2b01ee534860115f9a4019eda29af09] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,039 INFO [PostOpenDeployTasks:a2b01ee534860115f9a4019eda29af09] catalog.MetaEditor(464): Updated row testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,039 DEBUG [PostOpenDeployTasks:a2b01ee534860115f9a4019eda29af09] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,039 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning a2b01ee534860115f9a4019eda29af09 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:17,041 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/a2b01ee534860115f9a4019eda29af09 2014-06-15 07:46:17,041 DEBUG [RS_OPEN_REGION-asf008:57332-0] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node a2b01ee534860115f9a4019eda29af09 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:17,041 DEBUG [RS_OPEN_REGION-asf008:57332-0] coordination.ZkOpenRegionCoordination(91): Transitioned a2b01ee534860115f9a4019eda29af09 to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,041 DEBUG [RS_OPEN_REGION-asf008:57332-0] handler.OpenRegionHandler(167): Opened testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,041 DEBUG [AM.ZK.Worker-pool3-t13] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=a2b01ee534860115f9a4019eda29af09, current_state={a2b01ee534860115f9a4019eda29af09 state=OPENING, ts=1402818377025, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:17,041 INFO [AM.ZK.Worker-pool3-t13] master.RegionStates(813): Transition {a2b01ee534860115f9a4019eda29af09 state=OPENING, ts=1402818377025, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {a2b01ee534860115f9a4019eda29af09 state=OPEN, ts=1402818377041, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:17,041 DEBUG [AM.ZK.Worker-pool3-t13] coordination.ZkOpenRegionCoordination(350): Handling OPENED of a2b01ee534860115f9a4019eda29af09 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:17,042 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/a2b01ee534860115f9a4019eda29af09 2014-06-15 07:46:17,042 DEBUG [AM.ZK.Worker-pool3-t13] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node a2b01ee534860115f9a4019eda29af09 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:17,043 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:17,043 DEBUG [AM.ZK.Worker-pool3-t13] master.AssignmentManager$4(1293): Znode testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. deleted, state: {a2b01ee534860115f9a4019eda29af09 state=OPEN, ts=1402818377041, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:17,043 INFO [AM.ZK.Worker-pool3-t13] master.RegionStates(359): Onlined a2b01ee534860115f9a4019eda29af09 on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,240 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:17,240 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,243 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:17,243 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:17,244 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006b connected 2014-06-15 07:46:17,248 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,265 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:17,266 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,267 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:17,267 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:17,268 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006c connected 2014-06-15 07:46:17,278 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:17,278 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,279 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:17,279 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:17,280 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006d connected 2014-06-15 07:46:17,283 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,285 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:17,289 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' 2014-06-15 07:46:17,289 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,289 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' 2014-06-15 07:46:17,289 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:17,289 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,289 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,290 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,290 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,290 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,291 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,290 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,290 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,291 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,292 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,292 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,292 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,292 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,292 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,292 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,292 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,292 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:17,292 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,293 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,293 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,292 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,293 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,293 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,294 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,294 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,294 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,294 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,294 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,293 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,294 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,294 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,294 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,294 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,295 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,295 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,295 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,295 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:17,295 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool117-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,295 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:17,296 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool117-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. started... 2014-06-15 07:46:17,295 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,296 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,296 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool117-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09., current region memstore size 712 B 2014-06-15 07:46:17,298 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,300 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,301 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,301 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,301 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,301 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,315 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:17,316 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741908_1084 size 5165 2014-06-15 07:46:17,319 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool117-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/.tmp/78444632dde146908be3ccbc267be28f 2014-06-15 07:46:17,327 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool117-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/.tmp/78444632dde146908be3ccbc267be28f as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/info/78444632dde146908be3ccbc267be28f 2014-06-15 07:46:17,338 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool117-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/info/78444632dde146908be3ccbc267be28f, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:17,338 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool117-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. in 42ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:17,338 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool117-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,338 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:17,339 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:17,339 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,339 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,339 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,342 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,342 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,342 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,342 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,342 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,342 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,342 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,342 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,343 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,345 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' on coordinator 2014-06-15 07:46:17,345 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@18891c4[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:17,345 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:17,345 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,347 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,347 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,347 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,347 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,347 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,348 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,348 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,348 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,347 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,348 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:17,348 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,348 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,348 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,349 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,349 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,348 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,349 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,349 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,349 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:17,350 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,350 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,350 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,349 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,349 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,350 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,350 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:17,351 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,352 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,352 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,352 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,352 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,353 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,354 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,354 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,354 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,354 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,354 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,355 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,355 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,355 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,356 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,356 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,356 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilySpecificTimeStampWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:17,356 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,357 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,357 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,358 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,358 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,359 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,359 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,359 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,359 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,360 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,360 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,360 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,361 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:17,361 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteFamilySpecificTimeStampWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:17,361 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' execution completed 2014-06-15 07:46:17,361 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:17,361 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:17,361 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,361 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilySpecificTimeStampWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:17,369 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,369 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,369 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,369 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,369 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,369 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,369 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,369 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,370 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,427 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,427 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilySpecificTimeStampWithMulipleVersions' 2014-06-15 07:46:17,427 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:17,428 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilySpecificTimeStampWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:17,428 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:17,528 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:17,529 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:17,530 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,537 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:17,537 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,540 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:17,540 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:17,541 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006e connected 2014-06-15 07:46:17,553 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:17,553 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,564 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:17,564 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:17,565 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006f connected 2014-06-15 07:46:17,568 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,571 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:17,576 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteFamilySpecificTimeStampWithMulipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:17,576 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' 2014-06-15 07:46:17,576 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,576 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' 2014-06-15 07:46:17,576 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:17,577 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,577 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,578 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,578 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,578 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,578 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,578 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,579 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,578 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,579 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,579 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,579 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,579 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,580 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,580 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:17,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,580 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,580 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,580 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,581 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilySpecificTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:46:17,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,581 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,581 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,581 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,581 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,581 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,581 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,581 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilySpecificTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:46:17,582 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,582 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilySpecificTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:46:17,582 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,582 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,582 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,582 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,582 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool120-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,583 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,583 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool120-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. started... 2014-06-15 07:46:17,583 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,583 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,583 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool120-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09., current region memstore size 144 B 2014-06-15 07:46:17,583 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,582 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,582 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:17,584 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:17,584 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,584 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,585 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,586 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,586 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,587 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,587 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,587 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,597 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:17,597 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:17,599 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool120-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/.tmp/17a942197c774ae2a566609c63a9906c 2014-06-15 07:46:17,607 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool120-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/.tmp/17a942197c774ae2a566609c63a9906c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/info/17a942197c774ae2a566609c63a9906c 2014-06-15 07:46:17,617 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool120-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/info/17a942197c774ae2a566609c63a9906c, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:46:17,617 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool120-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. in 34ms, sequenceid=16, compaction requested=false 2014-06-15 07:46:17,617 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool120-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,617 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:17,617 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:17,618 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,618 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,618 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,620 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,620 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,620 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,620 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,620 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,620 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,621 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,621 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,622 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,622 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,622 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,623 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,623 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,624 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' on coordinator 2014-06-15 07:46:17,624 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1730d54[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:17,624 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:17,624 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,626 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,626 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,626 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,626 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,626 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,626 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,626 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,627 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,627 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,627 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,627 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,627 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:17,627 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,628 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,628 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,627 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,628 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,628 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:17,626 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,628 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,628 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,628 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:17,629 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,631 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,631 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,631 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,631 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,632 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,632 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,632 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,632 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,635 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,635 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,635 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,635 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,635 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,637 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,637 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,638 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,638 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,638 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,638 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,639 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilySpecificTimeStampWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:17,639 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,639 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,639 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,639 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,639 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,639 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,640 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,640 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,640 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,640 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,641 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,641 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,641 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,641 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,642 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,642 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,642 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,643 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:17,643 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteFamilySpecificTimeStampWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:17,643 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' execution completed 2014-06-15 07:46:17,643 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:17,643 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:17,643 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,643 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilySpecificTimeStampWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:17,650 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,650 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,650 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,650 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,650 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,651 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,651 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,651 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,651 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,655 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,655 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilySpecificTimeStampWithMulipleVersions' 2014-06-15 07:46:17,655 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:17,655 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilySpecificTimeStampWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:17,656 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:17,756 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:17,757 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:17,757 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a006e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,766 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:17,767 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,769 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:17,769 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:17,771 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0070 connected 2014-06-15 07:46:17,781 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:17,781 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,783 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:17,783 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:17,784 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0071 connected 2014-06-15 07:46:17,787 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0071, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:17,790 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:17,794 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteFamilySpecificTimeStampWithMulipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:17,794 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' 2014-06-15 07:46:17,794 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,794 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' 2014-06-15 07:46:17,794 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:17,795 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,795 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,796 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,796 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,796 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,797 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,797 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:17,797 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,798 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,798 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,798 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilySpecificTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:46:17,798 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,798 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,798 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,799 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,798 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,799 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,799 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,799 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,799 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,799 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,799 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,799 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,799 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,800 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,800 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,800 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,800 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:17,800 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,800 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,800 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,800 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,801 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilySpecificTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:46:17,801 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,801 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,801 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,801 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,801 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,801 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,801 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,801 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,801 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,802 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilySpecificTimeStampWithMulipleVersions is still present, removing 2014-06-15 07:46:17,802 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,803 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:17,803 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:17,803 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:17,803 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:17,803 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:17,803 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,804 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. started... 2014-06-15 07:46:17,804 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09., current region memstore size 136 B 2014-06-15 07:46:17,812 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,813 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,813 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,825 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:17,828 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741910_1086 size 5124 2014-06-15 07:46:17,829 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=136, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/.tmp/555ac63ed5e34dfc8e8ac92b3867e685 2014-06-15 07:46:17,842 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 555ac63ed5e34dfc8e8ac92b3867e685 2014-06-15 07:46:17,859 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/.tmp/555ac63ed5e34dfc8e8ac92b3867e685 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/info/555ac63ed5e34dfc8e8ac92b3867e685 2014-06-15 07:46:17,871 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 555ac63ed5e34dfc8e8ac92b3867e685 2014-06-15 07:46:17,871 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersions/a2b01ee534860115f9a4019eda29af09/info/555ac63ed5e34dfc8e8ac92b3867e685, entries=1, sequenceid=19, filesize=5.0 K 2014-06-15 07:46:17,872 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. in 68ms, sequenceid=19, compaction requested=true 2014-06-15 07:46:17,872 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool125-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:17,872 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:17,872 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:17,873 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,873 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally acquired 2014-06-15 07:46:17,873 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilySpecificTimeStampWithMulipleVersions) in zk 2014-06-15 07:46:17,875 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,875 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,876 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,876 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,876 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:17,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,877 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,877 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,877 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,877 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,878 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,878 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,878 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,878 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' on coordinator 2014-06-15 07:46:17,878 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@15e3f46[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:17,879 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:17,879 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,881 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,882 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,882 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,882 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,882 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,882 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,882 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,882 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,882 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,882 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,883 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,883 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,883 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:17,883 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:17,882 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,884 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,884 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:17,884 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,884 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' locally completed 2014-06-15 07:46:17,884 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,883 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,884 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:17,886 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,890 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,890 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,890 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,890 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,890 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,890 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,893 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:17,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,893 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,893 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' completed. 2014-06-15 07:46:17,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,897 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,897 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilySpecificTimeStampWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:17,898 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,898 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilySpecificTimeStampWithMulipleVersions/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:17,899 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:17,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:17,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,902 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:17,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:17,903 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,904 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:17,907 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:17,907 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:17,908 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:17,908 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteFamilySpecificTimeStampWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:17,908 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilySpecificTimeStampWithMulipleVersions' execution completed 2014-06-15 07:46:17,909 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:17,909 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:17,909 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilySpecificTimeStampWithMulipleVersions 2014-06-15 07:46:17,909 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilySpecificTimeStampWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:17,920 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,920 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,921 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:17,921 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,921 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,920 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:17,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:17,927 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:17,928 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilySpecificTimeStampWithMulipleVersions' 2014-06-15 07:46:17,928 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:17,929 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilySpecificTimeStampWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:17,929 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:18,029 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:18,030 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:18,031 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0070, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,064 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilySpecificTimeStampWithMulipleVersions Thread=378 (was 376) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1952120439_8 at /127.0.0.1:36374 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:40417 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:40406 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1285325219_8 at /127.0.0.1:40374 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) java.io.DataInputStream.readShort(DataInputStream.java:295) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:55) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:209) java.lang.Thread.run(Thread.java:662) - Thread LEAK? -, OpenFileDescriptor=578 (was 578), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 562), ProcessCount=176 (was 176), AvailableMemoryMB=2724 (was 2739), ConnectionCount=8 (was 8) 2014-06-15 07:46:18,085 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteColumns Thread=379, OpenFileDescriptor=580, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=176, AvailableMemoryMB=2724, ConnectionCount=8 2014-06-15 07:46:18,108 DEBUG [RpcServer.handler=1,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:18,111 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:18,113 INFO [RpcServer.handler=0,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testVisibilityLabelsWithDeleteColumns', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:18,117 DEBUG [RpcServer.handler=0,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testVisibilityLabelsWithDeleteColumns/write-master:458120000000000 2014-06-15 07:46:18,120 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,135 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:18,135 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:18,144 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testVisibilityLabelsWithDeleteColumns/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:18,145 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumns-1] regionserver.HRegion(4277): creating HRegion testVisibilityLabelsWithDeleteColumns HTD == 'testVisibilityLabelsWithDeleteColumns', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,159 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:18,159 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:18,162 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumns-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,162 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumns-1] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996.: disabling compactions & flushes 2014-06-15 07:46:18,162 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumns-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,163 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumns-1] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,168 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:18,170 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,171 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 75dc42947d06c508dee906a344931996 with OFFLINE state 2014-06-15 07:46:18,172 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:18,172 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={75dc42947d06c508dee906a344931996 state=OFFLINE, ts=1402818378170, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,173 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={75dc42947d06c508dee906a344931996 state=OFFLINE, ts=1402818378170, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,176 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:18,176 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {75dc42947d06c508dee906a344931996 state=OFFLINE, ts=1402818378171, server=null} to {75dc42947d06c508dee906a344931996 state=PENDING_OPEN, ts=1402818378176, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,177 INFO [Priority.RpcServer.handler=9,port=47197] regionserver.RSRpcServices(1230): Open testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,181 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 75dc42947d06c508dee906a344931996 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:18,181 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,182 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testVisibilityLabelsWithDeleteColumns state from ENABLING to ENABLED 2014-06-15 07:46:18,227 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/75dc42947d06c508dee906a344931996 2014-06-15 07:46:18,227 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 75dc42947d06c508dee906a344931996 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:18,228 DEBUG [AM.ZK.Worker-pool3-t15] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=75dc42947d06c508dee906a344931996, current_state={75dc42947d06c508dee906a344931996 state=PENDING_OPEN, ts=1402818378176, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,228 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(4462): Opening region: {ENCODED => 75dc42947d06c508dee906a344931996, NAME => 'testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:18,228 INFO [AM.ZK.Worker-pool3-t15] master.RegionStates(813): Transition {75dc42947d06c508dee906a344931996 state=PENDING_OPEN, ts=1402818378176, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {75dc42947d06c508dee906a344931996 state=OPENING, ts=1402818378228, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,228 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(5559): Registered coprocessor service: region=testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. service=VisibilityLabelsService 2014-06-15 07:46:18,229 INFO [RS_OPEN_REGION-asf008:47197-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:18,229 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testVisibilityLabelsWithDeleteColumns 75dc42947d06c508dee906a344931996 2014-06-15 07:46:18,229 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,230 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testVisibilityLabelsWithDeleteColumns/write-master:458120000000000 2014-06-15 07:46:18,236 INFO [StoreOpener-75dc42947d06c508dee906a344931996-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:18,237 INFO [StoreOpener-75dc42947d06c508dee906a344931996-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:18,238 DEBUG [StoreOpener-75dc42947d06c508dee906a344931996-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumns/75dc42947d06c508dee906a344931996/info 2014-06-15 07:46:18,239 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumns/75dc42947d06c508dee906a344931996 2014-06-15 07:46:18,241 INFO [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(747): Onlined 75dc42947d06c508dee906a344931996; next sequenceid=2 2014-06-15 07:46:18,241 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 75dc42947d06c508dee906a344931996 2014-06-15 07:46:18,242 INFO [PostOpenDeployTasks:75dc42947d06c508dee906a344931996] regionserver.HRegionServer(1663): Post open deploy tasks for testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,245 INFO [PostOpenDeployTasks:75dc42947d06c508dee906a344931996] catalog.MetaEditor(464): Updated row testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,245 DEBUG [PostOpenDeployTasks:75dc42947d06c508dee906a344931996] regionserver.HRegionServer(1693): Finished post open deploy task for testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,247 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 75dc42947d06c508dee906a344931996 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:18,250 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/75dc42947d06c508dee906a344931996 2014-06-15 07:46:18,250 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 75dc42947d06c508dee906a344931996 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:18,250 DEBUG [RS_OPEN_REGION-asf008:47197-1] coordination.ZkOpenRegionCoordination(91): Transitioned 75dc42947d06c508dee906a344931996 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,250 DEBUG [RS_OPEN_REGION-asf008:47197-1] handler.OpenRegionHandler(167): Opened testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,251 DEBUG [AM.ZK.Worker-pool3-t18] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=75dc42947d06c508dee906a344931996, current_state={75dc42947d06c508dee906a344931996 state=OPENING, ts=1402818378228, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,251 INFO [AM.ZK.Worker-pool3-t18] master.RegionStates(813): Transition {75dc42947d06c508dee906a344931996 state=OPENING, ts=1402818378228, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {75dc42947d06c508dee906a344931996 state=OPEN, ts=1402818378251, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,251 DEBUG [AM.ZK.Worker-pool3-t18] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 75dc42947d06c508dee906a344931996 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:18,255 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/75dc42947d06c508dee906a344931996 2014-06-15 07:46:18,255 DEBUG [AM.ZK.Worker-pool3-t18] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 75dc42947d06c508dee906a344931996 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:18,255 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:18,255 DEBUG [AM.ZK.Worker-pool3-t18] master.AssignmentManager$4(1293): Znode testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. deleted, state: {75dc42947d06c508dee906a344931996 state=OPEN, ts=1402818378251, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,255 INFO [AM.ZK.Worker-pool3-t18] master.RegionStates(359): Onlined 75dc42947d06c508dee906a344931996 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,436 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:18,436 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,438 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:18,439 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:18,440 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0072 connected 2014-06-15 07:46:18,443 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0072, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,448 INFO [pool-1-thread-1] hbase.Waiter(174): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2014-06-15 07:46:18,514 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:18,514 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,516 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:18,516 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:18,517 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0073 connected 2014-06-15 07:46:18,530 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:18,530 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,531 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:18,532 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:18,533 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0074 connected 2014-06-15 07:46:18,535 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0074, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,539 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:18,543 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteColumns' 2014-06-15 07:46:18,543 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:18,543 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteColumns' starting 'acquire' 2014-06-15 07:46:18,543 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteColumns', kicking off acquire phase on members. 2014-06-15 07:46:18,544 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,544 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,545 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:18,545 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:18,545 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:18,545 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:18,545 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:18,546 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:18,545 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,545 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:18,546 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:18,546 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:18,546 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,546 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,546 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,547 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:18,547 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,547 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,547 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,547 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,547 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:18,547 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,548 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumns' with timeout 60000ms 2014-06-15 07:46:18,549 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumns' with timeout 60000ms 2014-06-15 07:46:18,549 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:18,549 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:18,549 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumns' starting 'acquire' stage 2014-06-15 07:46:18,549 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumns' starting 'acquire' stage 2014-06-15 07:46:18,549 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumns' locally acquired 2014-06-15 07:46:18,548 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,549 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:18,550 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:18,550 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,549 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool127-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,550 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumns' with timeout 60000ms 2014-06-15 07:46:18,550 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool127-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. started... 2014-06-15 07:46:18,550 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:18,549 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumns) in zk 2014-06-15 07:46:18,551 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool127-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996., current region memstore size 416 B 2014-06-15 07:46:18,550 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumns' starting 'acquire' stage 2014-06-15 07:46:18,551 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumns' locally acquired 2014-06-15 07:46:18,552 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumns) in zk 2014-06-15 07:46:18,553 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,553 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,554 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,554 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,555 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumns' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:18,554 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumns' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:18,567 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:18,569 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741913_1089 size 4760 2014-06-15 07:46:18,570 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool127-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=9, memsize=416, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumns/75dc42947d06c508dee906a344931996/.tmp/c310a26252e743d589fa6a251e542e35 2014-06-15 07:46:18,579 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool127-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumns/75dc42947d06c508dee906a344931996/.tmp/c310a26252e743d589fa6a251e542e35 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumns/75dc42947d06c508dee906a344931996/info/c310a26252e743d589fa6a251e542e35 2014-06-15 07:46:18,587 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool127-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumns/75dc42947d06c508dee906a344931996/info/c310a26252e743d589fa6a251e542e35, entries=2, sequenceid=9, filesize=4.6 K 2014-06-15 07:46:18,587 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool127-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~416 B/416, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. in 36ms, sequenceid=9, compaction requested=false 2014-06-15 07:46:18,587 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool127-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:18,587 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:18,587 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:18,587 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,587 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumns' locally acquired 2014-06-15 07:46:18,587 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumns) in zk 2014-06-15 07:46:18,589 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,589 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,589 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,589 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,590 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,590 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:18,590 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,590 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:18,590 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumns' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:18,590 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:18,590 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,591 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:18,591 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,591 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:18,591 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:18,592 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:18,592 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteColumns' on coordinator 2014-06-15 07:46:18,592 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@de8fd6[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:18,592 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteColumns' starting 'in-barrier' execution. 2014-06-15 07:46:18,592 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,593 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,594 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,594 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,594 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,594 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:18,594 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumns' received 'reached' from coordinator. 2014-06-15 07:46:18,594 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:18,595 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumns' locally completed 2014-06-15 07:46:18,594 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,595 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumns' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:18,595 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,595 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:18,594 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumns' received 'reached' from coordinator. 2014-06-15 07:46:18,594 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,595 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumns' locally completed 2014-06-15 07:46:18,595 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumns' received 'reached' from coordinator. 2014-06-15 07:46:18,595 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumns' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:18,595 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,596 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumns' locally completed 2014-06-15 07:46:18,596 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumns' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:18,596 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumns' has notified controller of completion 2014-06-15 07:46:18,596 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:18,596 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:18,597 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumns' completed. 2014-06-15 07:46:18,597 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumns' has notified controller of completion 2014-06-15 07:46:18,598 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,598 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumns' has notified controller of completion 2014-06-15 07:46:18,598 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:18,598 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:18,598 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumns' completed. 2014-06-15 07:46:18,598 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:18,598 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:18,598 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumns' completed. 2014-06-15 07:46:18,598 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:18,599 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,599 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:18,599 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:18,599 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,600 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteColumns' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:18,600 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,600 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,600 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,600 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumns/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,600 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:18,600 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:18,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:18,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:18,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:18,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:18,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:18,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:18,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:18,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,603 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteColumns' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:18,604 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testVisibilityLabelsWithDeleteColumns', counting down latch. Waiting for 0 more 2014-06-15 07:46:18,604 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteColumns' execution completed 2014-06-15 07:46:18,604 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:18,604 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:18,604 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteColumns 2014-06-15 07:46:18,604 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteColumnsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:18,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:18,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:18,608 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:18,608 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:18,608 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:18,608 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:18,608 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:18,609 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:18,609 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:18,613 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:18,613 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteColumns' 2014-06-15 07:46:18,613 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:18,614 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteColumns'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:18,614 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:18,714 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:18,716 DEBUG [RpcServer.handler=2,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:18,716 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0073, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,749 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteColumns Thread=379 (was 379), OpenFileDescriptor=586 (was 580) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 562), ProcessCount=176 (was 176), AvailableMemoryMB=2684 (was 2724), ConnectionCount=8 (was 8) 2014-06-15 07:46:18,771 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion Thread=380, OpenFileDescriptor=588, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=176, AvailableMemoryMB=2683, ConnectionCount=8 2014-06-15 07:46:18,799 DEBUG [RpcServer.handler=2,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:18,823 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:18,826 INFO [RpcServer.handler=4,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:18,830 DEBUG [RpcServer.handler=4,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/write-master:458120000000000 2014-06-15 07:46:18,836 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:18,852 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:18,853 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741914_1090 size 347 2014-06-15 07:46:18,861 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:18,863 INFO [RegionOpenAndInitThread-testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion HTD == 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:18,881 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:18,881 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:18,884 DEBUG [RegionOpenAndInitThread-testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion-1] regionserver.HRegion(646): Instantiated testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:18,884 DEBUG [RegionOpenAndInitThread-testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion-1] regionserver.HRegion(1116): Closing testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23.: disabling compactions & flushes 2014-06-15 07:46:18,884 DEBUG [RegionOpenAndInitThread-testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:18,884 INFO [RegionOpenAndInitThread-testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion-1] regionserver.HRegion(1225): Closed testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:18,890 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:18,891 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,891 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 07e5ec76f887c00e779c0d44a49c3f23 with OFFLINE state 2014-06-15 07:46:18,892 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:18,892 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={07e5ec76f887c00e779c0d44a49c3f23 state=OFFLINE, ts=1402818378890, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,893 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={07e5ec76f887c00e779c0d44a49c3f23 state=OFFLINE, ts=1402818378890, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,896 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:18,896 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {07e5ec76f887c00e779c0d44a49c3f23 state=OFFLINE, ts=1402818378891, server=null} to {07e5ec76f887c00e779c0d44a49c3f23 state=PENDING_OPEN, ts=1402818378896, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,897 INFO [Priority.RpcServer.handler=8,port=47197] regionserver.RSRpcServices(1230): Open testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:18,903 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 07e5ec76f887c00e779c0d44a49c3f23 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:18,903 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,904 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion state from ENABLING to ENABLED 2014-06-15 07:46:18,906 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 07e5ec76f887c00e779c0d44a49c3f23 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:18,906 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/07e5ec76f887c00e779c0d44a49c3f23 2014-06-15 07:46:18,906 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(4462): Opening region: {ENCODED => 07e5ec76f887c00e779c0d44a49c3f23, NAME => 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:18,907 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. service=VisibilityLabelsService 2014-06-15 07:46:18,907 INFO [RS_OPEN_REGION-asf008:47197-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:18,907 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 07e5ec76f887c00e779c0d44a49c3f23 2014-06-15 07:46:18,907 DEBUG [AM.ZK.Worker-pool3-t20] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=07e5ec76f887c00e779c0d44a49c3f23, current_state={07e5ec76f887c00e779c0d44a49c3f23 state=PENDING_OPEN, ts=1402818378896, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,907 INFO [AM.ZK.Worker-pool3-t20] master.RegionStates(813): Transition {07e5ec76f887c00e779c0d44a49c3f23 state=PENDING_OPEN, ts=1402818378896, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {07e5ec76f887c00e779c0d44a49c3f23 state=OPENING, ts=1402818378907, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,907 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(646): Instantiated testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:18,909 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/write-master:458120000000000 2014-06-15 07:46:18,917 INFO [StoreOpener-07e5ec76f887c00e779c0d44a49c3f23-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:18,918 INFO [StoreOpener-07e5ec76f887c00e779c0d44a49c3f23-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:18,919 DEBUG [StoreOpener-07e5ec76f887c00e779c0d44a49c3f23-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/info 2014-06-15 07:46:18,920 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23 2014-06-15 07:46:18,923 INFO [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(747): Onlined 07e5ec76f887c00e779c0d44a49c3f23; next sequenceid=2 2014-06-15 07:46:18,923 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 07e5ec76f887c00e779c0d44a49c3f23 2014-06-15 07:46:18,923 INFO [PostOpenDeployTasks:07e5ec76f887c00e779c0d44a49c3f23] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:18,931 INFO [PostOpenDeployTasks:07e5ec76f887c00e779c0d44a49c3f23] catalog.MetaEditor(464): Updated row testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,931 DEBUG [PostOpenDeployTasks:07e5ec76f887c00e779c0d44a49c3f23] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:18,932 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 07e5ec76f887c00e779c0d44a49c3f23 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:18,933 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/07e5ec76f887c00e779c0d44a49c3f23 2014-06-15 07:46:18,933 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 07e5ec76f887c00e779c0d44a49c3f23 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:18,934 DEBUG [RS_OPEN_REGION-asf008:47197-2] coordination.ZkOpenRegionCoordination(91): Transitioned 07e5ec76f887c00e779c0d44a49c3f23 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,934 DEBUG [RS_OPEN_REGION-asf008:47197-2] handler.OpenRegionHandler(167): Opened testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,934 DEBUG [AM.ZK.Worker-pool3-t2] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=07e5ec76f887c00e779c0d44a49c3f23, current_state={07e5ec76f887c00e779c0d44a49c3f23 state=OPENING, ts=1402818378907, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,934 INFO [AM.ZK.Worker-pool3-t2] master.RegionStates(813): Transition {07e5ec76f887c00e779c0d44a49c3f23 state=OPENING, ts=1402818378907, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {07e5ec76f887c00e779c0d44a49c3f23 state=OPEN, ts=1402818378934, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,934 DEBUG [AM.ZK.Worker-pool3-t2] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 07e5ec76f887c00e779c0d44a49c3f23 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:18,937 DEBUG [AM.ZK.Worker-pool3-t2] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 07e5ec76f887c00e779c0d44a49c3f23 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:18,937 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/07e5ec76f887c00e779c0d44a49c3f23 2014-06-15 07:46:18,937 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:18,937 DEBUG [AM.ZK.Worker-pool3-t3] master.AssignmentManager$4(1293): Znode testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. deleted, state: {07e5ec76f887c00e779c0d44a49c3f23 state=OPEN, ts=1402818378934, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:18,937 INFO [AM.ZK.Worker-pool3-t3] master.RegionStates(359): Onlined 07e5ec76f887c00e779c0d44a49c3f23 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:18,947 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:18,947 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,950 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:18,951 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:18,952 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0075 connected 2014-06-15 07:46:18,957 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0075, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,982 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:18,983 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:18,988 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:18,989 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:18,990 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0076 connected 2014-06-15 07:46:19,005 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:19,006 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:19,008 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:19,009 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:19,010 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0077 connected 2014-06-15 07:46:19,015 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0077, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:19,107 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:19,112 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' 2014-06-15 07:46:19,113 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:19,113 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' starting 'acquire' 2014-06-15 07:46:19,113 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion', kicking off acquire phase on members. 2014-06-15 07:46:19,113 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,113 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,115 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,115 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,115 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,115 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,115 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,115 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,116 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,116 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,116 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,116 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,116 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,116 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:19,116 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,116 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,116 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,117 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,117 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,117 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:19,117 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,117 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:19,117 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,117 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,118 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,118 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,118 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:19,118 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,118 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,119 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,119 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' with timeout 60000ms 2014-06-15 07:46:19,120 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:19,120 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' starting 'acquire' stage 2014-06-15 07:46:19,125 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,125 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' with timeout 60000ms 2014-06-15 07:46:19,125 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,125 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:19,126 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' with timeout 60000ms 2014-06-15 07:46:19,126 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:19,126 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:19,126 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:19,126 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' starting 'acquire' stage 2014-06-15 07:46:19,126 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool129-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:19,126 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' locally acquired 2014-06-15 07:46:19,127 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool129-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. started... 2014-06-15 07:46:19,127 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion) in zk 2014-06-15 07:46:19,126 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' starting 'acquire' stage 2014-06-15 07:46:19,127 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' locally acquired 2014-06-15 07:46:19,127 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool129-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23., current region memstore size 712 B 2014-06-15 07:46:19,128 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion) in zk 2014-06-15 07:46:19,129 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,129 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,130 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:19,130 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,132 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,133 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:19,176 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:19,176 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:19,179 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool129-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/.tmp/4d3c1b0a6b6f4b52be537b29ff2e48f1 2014-06-15 07:46:19,189 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool129-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/.tmp/4d3c1b0a6b6f4b52be537b29ff2e48f1 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/info/4d3c1b0a6b6f4b52be537b29ff2e48f1 2014-06-15 07:46:19,202 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool129-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/info/4d3c1b0a6b6f4b52be537b29ff2e48f1, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:19,202 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool129-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. in 75ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:19,202 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool129-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:19,202 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:19,202 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:19,203 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,203 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' locally acquired 2014-06-15 07:46:19,203 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion) in zk 2014-06-15 07:46:19,205 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,206 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,206 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:19,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:19,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:19,206 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,207 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:19,207 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,208 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:19,208 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,208 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:19,208 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:19,209 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:19,210 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' on coordinator 2014-06-15 07:46:19,210 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1620d83[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:19,210 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' starting 'in-barrier' execution. 2014-06-15 07:46:19,210 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,212 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,212 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,212 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,212 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' received 'reached' from coordinator. 2014-06-15 07:46:19,212 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' locally completed 2014-06-15 07:46:19,213 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:19,213 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,213 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,213 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,213 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,213 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' received 'reached' from coordinator. 2014-06-15 07:46:19,213 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:19,213 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' locally completed 2014-06-15 07:46:19,213 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:19,212 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,213 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:19,214 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,214 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' received 'reached' from coordinator. 2014-06-15 07:46:19,214 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' locally completed 2014-06-15 07:46:19,214 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:19,215 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' has notified controller of completion 2014-06-15 07:46:19,213 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,215 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:19,215 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:19,215 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' completed. 2014-06-15 07:46:19,284 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' has notified controller of completion 2014-06-15 07:46:19,284 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:19,284 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,284 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' has notified controller of completion 2014-06-15 07:46:19,285 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:19,285 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' completed. 2014-06-15 07:46:19,284 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' completed. 2014-06-15 07:46:19,285 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:19,286 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,286 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:19,286 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:19,287 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:19,287 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,287 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:19,295 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:19,296 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,296 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:19,296 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,296 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,296 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,296 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,296 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:19,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:19,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:19,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:19,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:19,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:19,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:19,299 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,299 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:19,299 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:19,299 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,300 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:19,300 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion', counting down latch. Waiting for 0 more 2014-06-15 07:46:19,302 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' execution completed 2014-06-15 07:46:19,303 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:19,303 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:19,303 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion 2014-06-15 07:46:19,303 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:19,310 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,310 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,311 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,311 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,310 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,311 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,311 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,311 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,311 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,315 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:19,315 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion' 2014-06-15 07:46:19,316 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:19,316 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:19,317 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:19,417 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:19,418 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:19,419 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0076, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:19,464 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion Thread=379 (was 380), OpenFileDescriptor=591 (was 588) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=597 (was 562) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 176), AvailableMemoryMB=2664 (was 2683), ConnectionCount=8 (was 8) 2014-06-15 07:46:19,488 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression Thread=380, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=597, ProcessCount=176, AvailableMemoryMB=2663, ConnectionCount=8 2014-06-15 07:46:19,532 DEBUG [RpcServer.handler=2,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:19,534 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:19,539 INFO [RpcServer.handler=1,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:19,544 DEBUG [RpcServer.handler=1,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/write-master:458120000000000 2014-06-15 07:46:19,549 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,578 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:19,579 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:19,592 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:19,604 INFO [RegionOpenAndInitThread-testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression HTD == 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,630 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:19,630 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:19,633 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression-1] regionserver.HRegion(646): Instantiated testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:19,633 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression-1] regionserver.HRegion(1116): Closing testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4.: disabling compactions & flushes 2014-06-15 07:46:19,633 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:19,633 INFO [RegionOpenAndInitThread-testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression-1] regionserver.HRegion(1225): Closed testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:19,641 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:19,641 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,641 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 35df745f74b09ded3496284489dbc8f4 with OFFLINE state 2014-06-15 07:46:19,643 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:19,643 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={35df745f74b09ded3496284489dbc8f4 state=OFFLINE, ts=1402818379641, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,643 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={35df745f74b09ded3496284489dbc8f4 state=OFFLINE, ts=1402818379641, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,646 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:19,647 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {35df745f74b09ded3496284489dbc8f4 state=OFFLINE, ts=1402818379641, server=null} to {35df745f74b09ded3496284489dbc8f4 state=PENDING_OPEN, ts=1402818379647, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:19,647 INFO [Priority.RpcServer.handler=0,port=47197] regionserver.RSRpcServices(1230): Open testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:19,653 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 35df745f74b09ded3496284489dbc8f4 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:19,653 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,653 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression state from ENABLING to ENABLED 2014-06-15 07:46:19,655 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/35df745f74b09ded3496284489dbc8f4 2014-06-15 07:46:19,655 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 35df745f74b09ded3496284489dbc8f4 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:19,656 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(4462): Opening region: {ENCODED => 35df745f74b09ded3496284489dbc8f4, NAME => 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:19,656 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. service=VisibilityLabelsService 2014-06-15 07:46:19,656 INFO [RS_OPEN_REGION-asf008:47197-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:19,656 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 35df745f74b09ded3496284489dbc8f4 2014-06-15 07:46:19,657 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(646): Instantiated testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:19,709 INFO [StoreOpener-35df745f74b09ded3496284489dbc8f4-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:19,710 INFO [StoreOpener-35df745f74b09ded3496284489dbc8f4-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:19,712 DEBUG [StoreOpener-35df745f74b09ded3496284489dbc8f4-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/info 2014-06-15 07:46:19,713 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4 2014-06-15 07:46:19,715 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/write-master:458120000000000 2014-06-15 07:46:19,715 DEBUG [AM.ZK.Worker-pool3-t5] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=35df745f74b09ded3496284489dbc8f4, current_state={35df745f74b09ded3496284489dbc8f4 state=PENDING_OPEN, ts=1402818379647, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:19,716 INFO [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(747): Onlined 35df745f74b09ded3496284489dbc8f4; next sequenceid=2 2014-06-15 07:46:19,716 INFO [AM.ZK.Worker-pool3-t5] master.RegionStates(813): Transition {35df745f74b09ded3496284489dbc8f4 state=PENDING_OPEN, ts=1402818379647, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {35df745f74b09ded3496284489dbc8f4 state=OPENING, ts=1402818379716, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:19,716 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 35df745f74b09ded3496284489dbc8f4 2014-06-15 07:46:19,717 INFO [PostOpenDeployTasks:35df745f74b09ded3496284489dbc8f4] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:19,722 INFO [PostOpenDeployTasks:35df745f74b09ded3496284489dbc8f4] catalog.MetaEditor(464): Updated row testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,723 DEBUG [PostOpenDeployTasks:35df745f74b09ded3496284489dbc8f4] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:19,725 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 35df745f74b09ded3496284489dbc8f4 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:19,731 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 35df745f74b09ded3496284489dbc8f4 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:19,732 DEBUG [RS_OPEN_REGION-asf008:47197-0] coordination.ZkOpenRegionCoordination(91): Transitioned 35df745f74b09ded3496284489dbc8f4 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,732 DEBUG [RS_OPEN_REGION-asf008:47197-0] handler.OpenRegionHandler(167): Opened testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,735 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/35df745f74b09ded3496284489dbc8f4 2014-06-15 07:46:19,737 DEBUG [AM.ZK.Worker-pool3-t7] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=35df745f74b09ded3496284489dbc8f4, current_state={35df745f74b09ded3496284489dbc8f4 state=OPENING, ts=1402818379716, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:19,737 INFO [AM.ZK.Worker-pool3-t7] master.RegionStates(813): Transition {35df745f74b09ded3496284489dbc8f4 state=OPENING, ts=1402818379716, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {35df745f74b09ded3496284489dbc8f4 state=OPEN, ts=1402818379737, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:19,737 DEBUG [AM.ZK.Worker-pool3-t7] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 35df745f74b09ded3496284489dbc8f4 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:19,739 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/35df745f74b09ded3496284489dbc8f4 2014-06-15 07:46:19,739 DEBUG [AM.ZK.Worker-pool3-t7] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 35df745f74b09ded3496284489dbc8f4 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:19,739 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:19,740 DEBUG [AM.ZK.Worker-pool3-t7] master.AssignmentManager$4(1293): Znode testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. deleted, state: {35df745f74b09ded3496284489dbc8f4 state=OPEN, ts=1402818379737, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:19,740 INFO [AM.ZK.Worker-pool3-t7] master.RegionStates(359): Onlined 35df745f74b09ded3496284489dbc8f4 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,866 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:19,866 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:19,868 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:19,868 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:19,869 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0078 connected 2014-06-15 07:46:19,873 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0078, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:19,891 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:19,891 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:19,893 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:19,893 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:19,894 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0079 connected 2014-06-15 07:46:19,905 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:19,905 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:19,906 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:19,907 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:19,908 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007a connected 2014-06-15 07:46:19,910 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:19,912 INFO [RpcServer.handler=4,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:19,917 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' 2014-06-15 07:46:19,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:19,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' 2014-06-15 07:46:19,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression', kicking off acquire phase on members. 2014-06-15 07:46:19,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,918 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,918 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,918 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,918 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:19,919 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,919 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,919 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:19,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:19,920 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,920 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,920 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:19,920 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:19,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:19,920 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:19,920 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:19,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,921 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,921 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,921 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:19,921 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:19,921 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:19,921 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,922 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:19,922 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:19,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,922 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:19,922 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool132-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:19,922 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:19,922 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:19,922 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,922 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:19,922 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool132-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. started... 2014-06-15 07:46:19,923 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,923 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:19,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:19,924 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool132-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4., current region memstore size 712 B 2014-06-15 07:46:19,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:19,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:19,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:19,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:19,926 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,926 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,926 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,926 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:19,926 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:19,926 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:19,941 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:19,942 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741919_1095 size 5165 2014-06-15 07:46:19,943 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool132-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/.tmp/b66bb2c6f45749cb98859718f0d424e3 2014-06-15 07:46:19,992 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool132-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/.tmp/b66bb2c6f45749cb98859718f0d424e3 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/info/b66bb2c6f45749cb98859718f0d424e3 2014-06-15 07:46:20,006 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool132-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/info/b66bb2c6f45749cb98859718f0d424e3, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:20,006 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool132-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. in 82ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:20,006 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool132-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:20,007 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:20,007 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:20,007 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,007 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:20,007 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:20,010 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,010 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,010 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,011 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,011 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,011 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,011 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,011 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,011 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:20,011 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,012 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,012 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,012 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,012 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,013 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,013 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,013 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' on coordinator 2014-06-15 07:46:20,013 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@2f0180[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:20,013 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'in-barrier' execution. 2014-06-15 07:46:20,013 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,015 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,015 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,015 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,015 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,015 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,016 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,016 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,016 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,016 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,016 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,015 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,016 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,016 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,016 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,017 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:20,017 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,016 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,017 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:20,016 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:20,016 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,018 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,018 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,018 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,020 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,020 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,020 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,020 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,021 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,021 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,021 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,021 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,021 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,022 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,022 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,022 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,024 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:20,024 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,024 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,026 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,026 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,026 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:20,028 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression', counting down latch. Waiting for 0 more 2014-06-15 07:46:20,028 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' execution completed 2014-06-15 07:46:20,028 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:20,029 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:20,029 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,029 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpressionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:20,033 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,033 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,033 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,033 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,034 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,034 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,097 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,098 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' 2014-06-15 07:46:20,098 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:20,098 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:20,099 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:20,199 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:20,200 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:20,201 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0079, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,206 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:20,206 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,208 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:20,208 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:20,209 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007b connected 2014-06-15 07:46:20,220 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:20,221 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,223 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:20,223 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:20,224 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007c connected 2014-06-15 07:46:20,228 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,231 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:20,236 DEBUG [RpcServer.handler=3,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:20,236 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' 2014-06-15 07:46:20,237 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:20,237 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' 2014-06-15 07:46:20,237 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression', kicking off acquire phase on members. 2014-06-15 07:46:20,237 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,237 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,238 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,238 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,238 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,239 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,239 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,238 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,239 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,239 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,239 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,239 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,239 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,239 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:20,240 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,240 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:20,241 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,241 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,240 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,241 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,241 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression is still present, removing 2014-06-15 07:46:20,241 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,241 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:20,241 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:20,241 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:20,241 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:20,241 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:20,242 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression is still present, removing 2014-06-15 07:46:20,242 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,242 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:20,242 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:20,242 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression is still present, removing 2014-06-15 07:46:20,242 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:20,243 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,243 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:20,243 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool137-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:20,243 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:20,243 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool137-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. started... 2014-06-15 07:46:20,243 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:20,243 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:20,243 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool137-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4., current region memstore size 144 B 2014-06-15 07:46:20,243 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:20,243 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:20,244 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,244 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:20,245 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,245 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:20,245 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,246 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,246 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:20,267 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:20,267 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:20,269 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool137-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/.tmp/4f655187e0694579ab31ed4d1a827fcf 2014-06-15 07:46:20,279 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool137-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/.tmp/4f655187e0694579ab31ed4d1a827fcf as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/info/4f655187e0694579ab31ed4d1a827fcf 2014-06-15 07:46:20,286 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool137-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/info/4f655187e0694579ab31ed4d1a827fcf, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:46:20,286 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool137-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. in 43ms, sequenceid=16, compaction requested=false 2014-06-15 07:46:20,286 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool137-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:20,286 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:20,286 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:20,286 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,286 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:20,286 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:20,289 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,289 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,289 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,289 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,289 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,289 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,289 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,289 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,290 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,290 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,290 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:20,290 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,290 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,291 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,291 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' on coordinator 2014-06-15 07:46:20,291 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@6722a6[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:20,291 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'in-barrier' execution. 2014-06-15 07:46:20,292 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,292 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,293 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,293 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,294 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,294 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,294 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:20,294 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,294 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,294 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:20,293 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,294 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,294 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:20,295 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,295 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,295 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,296 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,296 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,296 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,296 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,296 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,296 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,296 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,297 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,297 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,297 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,297 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,298 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,299 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,299 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:20,299 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,299 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,299 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,300 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,300 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,300 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,300 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,300 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,301 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,301 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,301 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,301 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,302 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,302 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,302 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,303 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,303 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,303 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:20,303 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression', counting down latch. Waiting for 0 more 2014-06-15 07:46:20,303 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' execution completed 2014-06-15 07:46:20,304 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:20,304 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:20,304 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,304 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpressionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:20,310 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,311 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,311 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,311 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,311 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,311 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,311 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,311 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,311 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,318 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,318 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' 2014-06-15 07:46:20,318 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:20,318 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:20,318 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:20,419 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:20,420 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:20,420 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,428 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:20,428 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,431 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:20,431 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:20,432 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007d connected 2014-06-15 07:46:20,443 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:20,444 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,445 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:20,446 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:20,447 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007e connected 2014-06-15 07:46:20,450 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,498 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:20,503 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:20,503 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' 2014-06-15 07:46:20,503 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:20,503 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' 2014-06-15 07:46:20,503 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression', kicking off acquire phase on members. 2014-06-15 07:46:20,503 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,504 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,505 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,505 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,505 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,505 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,505 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,505 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,505 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,505 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,505 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,506 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,506 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,506 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,506 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,506 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,506 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,507 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:20,507 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,507 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:20,507 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,507 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,507 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,506 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,507 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:20,506 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,508 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:20,508 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,508 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,508 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression is still present, removing 2014-06-15 07:46:20,509 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,509 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:20,509 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:20,509 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:20,509 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:20,509 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:20,509 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression is still present, removing 2014-06-15 07:46:20,509 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,509 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:20,510 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:20,510 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:20,510 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression is still present, removing 2014-06-15 07:46:20,510 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,510 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' with timeout 60000ms 2014-06-15 07:46:20,510 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:20,510 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'acquire' stage 2014-06-15 07:46:20,510 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:20,510 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool140-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:20,510 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:20,511 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool140-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. started... 2014-06-15 07:46:20,511 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:20,510 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:20,511 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool140-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4., current region memstore size 144 B 2014-06-15 07:46:20,516 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,518 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,518 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,518 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:20,518 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,518 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:20,535 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:20,536 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:20,539 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool140-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/.tmp/8cf208680cd949bdb0ab98a970655093 2014-06-15 07:46:20,551 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool140-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/.tmp/8cf208680cd949bdb0ab98a970655093 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/info/8cf208680cd949bdb0ab98a970655093 2014-06-15 07:46:20,561 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool140-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/35df745f74b09ded3496284489dbc8f4/info/8cf208680cd949bdb0ab98a970655093, entries=1, sequenceid=19, filesize=4.8 K 2014-06-15 07:46:20,562 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool140-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. in 51ms, sequenceid=19, compaction requested=true 2014-06-15 07:46:20,562 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool140-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:20,562 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:20,562 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:20,562 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,562 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally acquired 2014-06-15 07:46:20,562 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression) in zk 2014-06-15 07:46:20,564 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,565 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,565 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,565 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,565 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,565 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,565 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,565 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,565 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,565 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:20,566 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,566 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,566 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,566 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,567 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,567 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,567 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' on coordinator 2014-06-15 07:46:20,567 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@c47680[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:20,567 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' starting 'in-barrier' execution. 2014-06-15 07:46:20,567 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,569 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,569 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,569 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,569 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,569 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,569 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,570 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,570 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,569 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,570 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:20,570 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,570 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,570 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:20,570 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,571 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,569 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,571 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,571 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' received 'reached' from coordinator. 2014-06-15 07:46:20,571 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' locally completed 2014-06-15 07:46:20,571 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:20,572 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,572 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,572 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,572 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,574 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,574 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,574 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,575 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' has notified controller of completion 2014-06-15 07:46:20,575 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,575 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' completed. 2014-06-15 07:46:20,575 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,576 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,577 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,578 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,579 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,579 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:20,579 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,579 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,579 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,579 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:20,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:20,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:20,580 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,581 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:20,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:20,582 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:20,583 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:20,584 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:20,584 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:20,585 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression', counting down latch. Waiting for 0 more 2014-06-15 07:46:20,585 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' execution completed 2014-06-15 07:46:20,585 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:20,585 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:20,585 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression 2014-06-15 07:46:20,585 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpressionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:20,591 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,592 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,592 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:20,592 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,592 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,592 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,592 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,592 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:20,592 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:20,598 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:20,598 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression' 2014-06-15 07:46:20,598 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:20,599 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:20,599 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:20,699 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:20,701 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:20,701 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:20,738 ERROR [RpcServer.handler=0,port=47197] ipc.RpcServer(2042): Unexpected throwable object java.lang.AssertionError at org.apache.hadoop.hbase.security.visibility.VisibilityScanDeleteTracker.isDeleted(VisibilityScanDeleteTracker.java:235) at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:366) at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:490) at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:139) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3893) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3973) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3842) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3833) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:1948) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29497) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2005) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:221) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:43) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:162) at java.lang.Thread.run(Thread.java:662) 2014-06-15 07:46:21,047 ERROR [RpcServer.handler=4,port=47197] ipc.RpcServer(2042): Unexpected throwable object java.lang.AssertionError at org.apache.hadoop.hbase.security.visibility.VisibilityScanDeleteTracker.isDeleted(VisibilityScanDeleteTracker.java:235) at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:366) at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:490) at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:139) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3893) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3973) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3842) at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3833) at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:1948) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29497) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2005) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:221) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:43) at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:162) at java.lang.Thread.run(Thread.java:662) 2014-06-15 07:46:21,381 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression Thread=377 (was 380), OpenFileDescriptor=585 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=597 (was 597), ProcessCount=176 (was 176), AvailableMemoryMB=3003 (was 2663) - AvailableMemoryMB LEAK? -, ConnectionCount=8 (was 8) 2014-06-15 07:46:21,406 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteColumnExactVersion Thread=378, OpenFileDescriptor=587, MaxFileDescriptor=60000, SystemLoadAverage=597, ProcessCount=176, AvailableMemoryMB=3003, ConnectionCount=8 2014-06-15 07:46:21,459 DEBUG [RpcServer.handler=0,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:21,465 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:21,468 INFO [RpcServer.handler=3,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testVisibilityLabelsWithDeleteColumnExactVersion', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:21,483 DEBUG [RpcServer.handler=3,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testVisibilityLabelsWithDeleteColumnExactVersion/write-master:458120000000000 2014-06-15 07:46:21,489 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,506 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:21,508 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:21,519 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:21,521 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnExactVersion-1] regionserver.HRegion(4277): creating HRegion testVisibilityLabelsWithDeleteColumnExactVersion HTD == 'testVisibilityLabelsWithDeleteColumnExactVersion', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,544 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:21,544 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741923_1099 size 81 2014-06-15 07:46:21,547 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnExactVersion-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,548 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnExactVersion-1] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0.: disabling compactions & flushes 2014-06-15 07:46:21,548 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnExactVersion-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,548 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteColumnExactVersion-1] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,554 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:21,554 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,554 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 3d434c2f0b101494ab623de4b7b766f0 with OFFLINE state 2014-06-15 07:46:21,556 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:21,556 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={3d434c2f0b101494ab623de4b7b766f0 state=OFFLINE, ts=1402818381554, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,556 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={3d434c2f0b101494ab623de4b7b766f0 state=OFFLINE, ts=1402818381554, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,560 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:21,560 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {3d434c2f0b101494ab623de4b7b766f0 state=OFFLINE, ts=1402818381554, server=null} to {3d434c2f0b101494ab623de4b7b766f0 state=PENDING_OPEN, ts=1402818381560, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:21,560 INFO [Priority.RpcServer.handler=1,port=57332] regionserver.RSRpcServices(1230): Open testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,564 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 3d434c2f0b101494ab623de4b7b766f0 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:21,564 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,564 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testVisibilityLabelsWithDeleteColumnExactVersion state from ENABLING to ENABLED 2014-06-15 07:46:21,566 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 3d434c2f0b101494ab623de4b7b766f0 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:21,566 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3d434c2f0b101494ab623de4b7b766f0 2014-06-15 07:46:21,566 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(4462): Opening region: {ENCODED => 3d434c2f0b101494ab623de4b7b766f0, NAME => 'testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:21,566 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(5559): Registered coprocessor service: region=testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. service=VisibilityLabelsService 2014-06-15 07:46:21,567 INFO [RS_OPEN_REGION-asf008:57332-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:21,567 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testVisibilityLabelsWithDeleteColumnExactVersion/write-master:458120000000000 2014-06-15 07:46:21,567 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testVisibilityLabelsWithDeleteColumnExactVersion 3d434c2f0b101494ab623de4b7b766f0 2014-06-15 07:46:21,567 DEBUG [AM.ZK.Worker-pool3-t10] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=3d434c2f0b101494ab623de4b7b766f0, current_state={3d434c2f0b101494ab623de4b7b766f0 state=PENDING_OPEN, ts=1402818381560, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:21,567 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,567 INFO [AM.ZK.Worker-pool3-t10] master.RegionStates(813): Transition {3d434c2f0b101494ab623de4b7b766f0 state=PENDING_OPEN, ts=1402818381560, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {3d434c2f0b101494ab623de4b7b766f0 state=OPENING, ts=1402818381567, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:21,572 INFO [StoreOpener-3d434c2f0b101494ab623de4b7b766f0-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:21,573 INFO [StoreOpener-3d434c2f0b101494ab623de4b7b766f0-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:21,574 DEBUG [StoreOpener-3d434c2f0b101494ab623de4b7b766f0-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/info 2014-06-15 07:46:21,575 DEBUG [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0 2014-06-15 07:46:21,576 INFO [RS_OPEN_REGION-asf008:57332-1] regionserver.HRegion(747): Onlined 3d434c2f0b101494ab623de4b7b766f0; next sequenceid=2 2014-06-15 07:46:21,576 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 3d434c2f0b101494ab623de4b7b766f0 2014-06-15 07:46:21,577 INFO [PostOpenDeployTasks:3d434c2f0b101494ab623de4b7b766f0] regionserver.HRegionServer(1663): Post open deploy tasks for testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,581 INFO [PostOpenDeployTasks:3d434c2f0b101494ab623de4b7b766f0] catalog.MetaEditor(464): Updated row testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,581 DEBUG [PostOpenDeployTasks:3d434c2f0b101494ab623de4b7b766f0] regionserver.HRegionServer(1693): Finished post open deploy task for testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,581 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 3d434c2f0b101494ab623de4b7b766f0 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:21,583 DEBUG [RS_OPEN_REGION-asf008:57332-1] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 3d434c2f0b101494ab623de4b7b766f0 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:21,583 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/3d434c2f0b101494ab623de4b7b766f0 2014-06-15 07:46:21,583 DEBUG [RS_OPEN_REGION-asf008:57332-1] coordination.ZkOpenRegionCoordination(91): Transitioned 3d434c2f0b101494ab623de4b7b766f0 to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,584 DEBUG [RS_OPEN_REGION-asf008:57332-1] handler.OpenRegionHandler(167): Opened testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,584 DEBUG [AM.ZK.Worker-pool3-t11] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=3d434c2f0b101494ab623de4b7b766f0, current_state={3d434c2f0b101494ab623de4b7b766f0 state=OPENING, ts=1402818381567, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:21,584 INFO [AM.ZK.Worker-pool3-t11] master.RegionStates(813): Transition {3d434c2f0b101494ab623de4b7b766f0 state=OPENING, ts=1402818381567, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {3d434c2f0b101494ab623de4b7b766f0 state=OPEN, ts=1402818381584, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:21,584 DEBUG [AM.ZK.Worker-pool3-t11] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 3d434c2f0b101494ab623de4b7b766f0 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:21,585 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/3d434c2f0b101494ab623de4b7b766f0 2014-06-15 07:46:21,585 DEBUG [AM.ZK.Worker-pool3-t11] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 3d434c2f0b101494ab623de4b7b766f0 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:21,585 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:21,586 DEBUG [AM.ZK.Worker-pool3-t11] master.AssignmentManager$4(1293): Znode testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. deleted, state: {3d434c2f0b101494ab623de4b7b766f0 state=OPEN, ts=1402818381584, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:21,586 INFO [AM.ZK.Worker-pool3-t11] master.RegionStates(359): Onlined 3d434c2f0b101494ab623de4b7b766f0 on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,597 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:21,598 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,600 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:21,601 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:21,602 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007f connected 2014-06-15 07:46:21,604 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a007f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,606 INFO [pool-1-thread-1] hbase.Waiter(174): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2014-06-15 07:46:21,618 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:21,618 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,620 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:21,620 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:21,621 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0080 connected 2014-06-15 07:46:21,630 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:21,631 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,632 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:21,632 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:21,633 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0081 connected 2014-06-15 07:46:21,635 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0081, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,638 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:21,642 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' 2014-06-15 07:46:21,642 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:21,642 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' 2014-06-15 07:46:21,642 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteColumnExactVersion', kicking off acquire phase on members. 2014-06-15 07:46:21,642 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,642 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,643 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,643 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,643 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,644 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,643 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,644 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,644 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,644 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:21,644 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,643 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,644 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,644 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,645 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:21,646 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,646 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:21,646 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,646 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,646 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,646 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:21,646 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,646 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:21,646 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,646 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:21,646 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:21,646 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:21,647 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:21,648 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:21,648 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool143-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,648 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:21,648 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool143-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. started... 2014-06-15 07:46:21,648 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,650 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool143-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0., current region memstore size 144 B 2014-06-15 07:46:21,651 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,651 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,651 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:21,651 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,651 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:21,665 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:21,666 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:21,667 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool143-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=5, memsize=144, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/.tmp/1e1cb13236b54840a8c76128e8d8877c 2014-06-15 07:46:21,676 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool143-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/.tmp/1e1cb13236b54840a8c76128e8d8877c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/info/1e1cb13236b54840a8c76128e8d8877c 2014-06-15 07:46:21,690 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool143-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/info/1e1cb13236b54840a8c76128e8d8877c, entries=1, sequenceid=5, filesize=4.6 K 2014-06-15 07:46:21,693 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool143-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. in 43ms, sequenceid=5, compaction requested=false 2014-06-15 07:46:21,693 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool143-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,693 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:21,693 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:21,693 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,693 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:21,693 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:21,695 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,696 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,696 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:21,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:21,696 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,697 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:21,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:21,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:21,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:21,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:21,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:21,699 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' on coordinator 2014-06-15 07:46:21,699 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@11efc39[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:21,699 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'in-barrier' execution. 2014-06-15 07:46:21,699 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,701 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,701 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,701 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,701 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,702 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,702 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,702 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,702 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:21,702 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,702 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,702 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:21,703 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:21,702 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:21,703 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:21,703 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:21,703 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:21,703 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:21,703 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:21,702 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,703 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,704 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:21,704 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:21,704 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,704 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:21,707 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:21,707 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:21,707 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:21,707 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:21,707 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:21,707 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:21,708 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:21,709 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:21,709 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,709 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:21,709 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:21,710 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:21,710 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:21,711 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:21,711 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,711 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:21,712 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:21,712 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,713 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteColumnExactVersion' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:21,713 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,714 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,714 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,714 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,714 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:21,714 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:21,714 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:21,715 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,715 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:21,715 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,715 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:21,716 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:21,716 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:21,716 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,717 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:21,717 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:21,717 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,724 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:21,724 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteColumnExactVersion', counting down latch. Waiting for 0 more 2014-06-15 07:46:21,724 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' execution completed 2014-06-15 07:46:21,724 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:21,725 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:21,725 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,725 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteColumnExactVersionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:21,762 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,762 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,763 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,763 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,762 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,762 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,764 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,764 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,763 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,798 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:21,798 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteColumnExactVersion' 2014-06-15 07:46:21,798 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:21,799 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteColumnExactVersion'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:21,799 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:21,899 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:21,901 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:21,901 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0080, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,908 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:21,908 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,911 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:21,911 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:21,913 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0082 connected 2014-06-15 07:46:21,925 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:21,926 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,927 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:21,928 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:21,929 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0083 connected 2014-06-15 07:46:21,931 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0083, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:21,934 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:21,938 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testVisibilityLabelsWithDeleteColumnExactVersion was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:21,938 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' 2014-06-15 07:46:21,939 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:21,939 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' 2014-06-15 07:46:21,939 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteColumnExactVersion', kicking off acquire phase on members. 2014-06-15 07:46:21,939 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,939 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,941 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,941 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,942 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,942 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,941 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,942 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,942 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,942 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:21,942 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:21,942 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:21,943 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,943 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,943 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,943 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,943 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:21,943 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,943 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,943 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,943 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:21,944 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnExactVersion is still present, removing 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,944 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:21,944 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,945 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:21,945 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnExactVersion is still present, removing 2014-06-15 07:46:21,945 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnExactVersion is still present, removing 2014-06-15 07:46:21,945 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,945 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,945 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:21,945 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:21,945 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:21,945 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:21,945 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:21,946 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:21,946 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:21,946 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:21,945 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:21,946 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:21,946 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:21,946 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:21,946 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool145-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,946 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:21,946 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool145-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. started... 2014-06-15 07:46:21,947 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool145-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0., current region memstore size 136 B 2014-06-15 07:46:21,947 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,952 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,952 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,952 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:21,952 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,952 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:21,963 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:21,964 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:21,968 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool145-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=8, memsize=136, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/.tmp/7e63acecce6a41ad9f9009ce6322d401 2014-06-15 07:46:21,977 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool145-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/.tmp/7e63acecce6a41ad9f9009ce6322d401 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/info/7e63acecce6a41ad9f9009ce6322d401 2014-06-15 07:46:21,988 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool145-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/info/7e63acecce6a41ad9f9009ce6322d401, entries=1, sequenceid=8, filesize=4.6 K 2014-06-15 07:46:21,988 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool145-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. in 41ms, sequenceid=8, compaction requested=false 2014-06-15 07:46:21,988 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool145-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:21,988 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:21,989 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:21,989 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,989 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:21,989 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:21,992 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,992 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,992 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,992 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,992 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,992 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,992 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:21,992 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:21,992 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:21,993 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:21,993 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,993 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:21,993 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,994 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:21,994 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:21,994 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:21,994 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' on coordinator 2014-06-15 07:46:21,995 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@39440[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:21,995 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'in-barrier' execution. 2014-06-15 07:46:21,995 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,996 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,996 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,996 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,996 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,997 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,997 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:21,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,997 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:21,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:21,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:21,997 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:21,997 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:21,996 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,998 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:21,998 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:21,998 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:21,998 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:21,998 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:21,998 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:21,998 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:21,998 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:22,000 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:22,000 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,000 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:22,001 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,002 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:22,002 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,002 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:22,002 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:22,002 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,002 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,003 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:22,003 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,003 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,003 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:22,004 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:22,004 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,004 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,004 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,004 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,005 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteColumnExactVersion' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:22,005 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,005 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,005 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,005 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,005 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:22,005 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:22,005 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:22,006 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,006 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,006 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,006 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,007 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:22,007 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:22,007 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,007 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,007 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,008 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,008 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:22,008 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteColumnExactVersion', counting down latch. Waiting for 0 more 2014-06-15 07:46:22,008 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' execution completed 2014-06-15 07:46:22,008 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:22,008 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:22,008 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,008 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteColumnExactVersionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:22,012 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,012 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,012 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,013 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,013 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,013 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,012 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,013 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,013 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,188 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,188 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteColumnExactVersion' 2014-06-15 07:46:22,189 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:22,189 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteColumnExactVersion'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:22,190 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:22,290 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:22,291 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:22,292 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0082, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,301 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:22,302 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,303 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:22,303 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:22,304 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0084 connected 2014-06-15 07:46:22,315 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:22,315 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,316 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:22,316 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:22,317 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0085 connected 2014-06-15 07:46:22,319 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0085, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,335 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:22,340 DEBUG [RpcServer.handler=1,port=45812] procedure.ProcedureCoordinator(158): Procedure testVisibilityLabelsWithDeleteColumnExactVersion was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:22,340 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' 2014-06-15 07:46:22,340 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:22,340 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' 2014-06-15 07:46:22,340 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteColumnExactVersion', kicking off acquire phase on members. 2014-06-15 07:46:22,340 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,341 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,342 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,342 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,342 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,342 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,342 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,342 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,342 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,343 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,342 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,343 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,343 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:22,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,343 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,343 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,344 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnExactVersion is still present, removing 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,344 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,345 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:22,345 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnExactVersion is still present, removing 2014-06-15 07:46:22,345 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:22,345 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,345 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:22,345 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:22,345 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:22,345 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:22,345 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:22,346 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:22,346 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testVisibilityLabelsWithDeleteColumnExactVersion is still present, removing 2014-06-15 07:46:22,346 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,346 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:22,346 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' with timeout 60000ms 2014-06-15 07:46:22,346 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:22,347 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:22,347 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'acquire' stage 2014-06-15 07:46:22,347 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:22,347 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:22,347 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,346 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool147-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:22,348 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,348 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:22,348 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool147-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. started... 2014-06-15 07:46:22,348 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool147-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0., current region memstore size 136 B 2014-06-15 07:46:22,348 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,349 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,349 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:22,362 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:22,363 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741926_1102 size 4714 2014-06-15 07:46:22,365 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool147-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=11, memsize=136, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/.tmp/4208968f5ae747729c437f78ba3c8402 2014-06-15 07:46:22,374 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool147-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/.tmp/4208968f5ae747729c437f78ba3c8402 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/info/4208968f5ae747729c437f78ba3c8402 2014-06-15 07:46:22,381 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool147-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteColumnExactVersion/3d434c2f0b101494ab623de4b7b766f0/info/4208968f5ae747729c437f78ba3c8402, entries=1, sequenceid=11, filesize=4.6 K 2014-06-15 07:46:22,381 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool147-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. in 33ms, sequenceid=11, compaction requested=true 2014-06-15 07:46:22,381 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool147-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:22,382 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:22,382 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:22,382 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,382 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally acquired 2014-06-15 07:46:22,382 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteColumnExactVersion) in zk 2014-06-15 07:46:22,383 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,383 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,384 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,384 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,384 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,384 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:22,384 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,384 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:22,384 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:22,384 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:22,384 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,385 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,385 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,385 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,385 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:22,386 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:22,386 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' on coordinator 2014-06-15 07:46:22,386 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1ee8099[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:22,386 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' starting 'in-barrier' execution. 2014-06-15 07:46:22,386 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,387 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,387 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,387 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,387 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,388 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,388 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:22,388 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,388 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:22,388 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:22,388 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:22,388 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:22,388 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:22,388 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,389 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:22,389 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:22,387 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,389 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,389 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,388 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,389 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' received 'reached' from coordinator. 2014-06-15 07:46:22,389 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' locally completed 2014-06-15 07:46:22,389 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:22,389 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:22,390 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:22,390 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,390 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:22,390 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:22,390 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,390 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,390 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:22,391 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' has notified controller of completion 2014-06-15 07:46:22,391 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,391 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,391 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteColumnExactVersion' completed. 2014-06-15 07:46:22,392 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,392 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,392 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:22,392 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:22,392 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,393 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,393 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,393 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,394 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteColumnExactVersion' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:22,394 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,394 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,394 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,394 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteColumnExactVersion/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,394 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:22,394 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:22,394 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:22,394 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,395 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,395 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,395 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,395 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:22,395 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:22,396 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,396 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,396 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,396 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,397 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:22,397 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testVisibilityLabelsWithDeleteColumnExactVersion', counting down latch. Waiting for 0 more 2014-06-15 07:46:22,397 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteColumnExactVersion' execution completed 2014-06-15 07:46:22,397 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:22,397 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:22,397 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteColumnExactVersion 2014-06-15 07:46:22,397 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteColumnExactVersionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:22,401 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,401 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,401 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,402 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,402 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,402 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,402 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,402 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,402 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,408 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,408 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteColumnExactVersion' 2014-06-15 07:46:22,408 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:22,409 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteColumnExactVersion'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:22,409 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:22,509 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:22,511 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:22,511 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0084, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,546 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteColumnExactVersion Thread=378 (was 378), OpenFileDescriptor=596 (was 587) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=597 (was 597), ProcessCount=176 (was 176), AvailableMemoryMB=3287 (was 3003) - AvailableMemoryMB LEAK? -, ConnectionCount=8 (was 8) 2014-06-15 07:46:22,577 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts Thread=379, OpenFileDescriptor=598, MaxFileDescriptor=60000, SystemLoadAverage=597, ProcessCount=176, AvailableMemoryMB=3276, ConnectionCount=8 2014-06-15 07:46:22,644 DEBUG [RpcServer.handler=2,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:22,647 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:22,650 INFO [RpcServer.handler=1,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:22,663 DEBUG [RpcServer.handler=1,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/write-master:458120000000000 2014-06-15 07:46:22,669 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,684 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:22,685 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:22,692 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:22,694 INFO [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts-1] regionserver.HRegion(4277): creating HRegion testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts HTD == 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,711 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:22,712 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741928_1104 size 110 2014-06-15 07:46:22,713 DEBUG [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts-1] regionserver.HRegion(646): Instantiated testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,713 DEBUG [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts-1] regionserver.HRegion(1116): Closing testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db.: disabling compactions & flushes 2014-06-15 07:46:22,713 DEBUG [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts-1] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,714 INFO [RegionOpenAndInitThread-testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts-1] regionserver.HRegion(1225): Closed testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,719 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:22,719 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,720 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 77a9376ac9bcef2c010fc93c023006db with OFFLINE state 2014-06-15 07:46:22,722 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:22,722 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={77a9376ac9bcef2c010fc93c023006db state=OFFLINE, ts=1402818382719, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,722 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={77a9376ac9bcef2c010fc93c023006db state=OFFLINE, ts=1402818382719, server=null}, server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,725 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,57332,1402818342381 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:22,725 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {77a9376ac9bcef2c010fc93c023006db state=OFFLINE, ts=1402818382720, server=null} to {77a9376ac9bcef2c010fc93c023006db state=PENDING_OPEN, ts=1402818382725, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:22,726 INFO [Priority.RpcServer.handler=2,port=57332] regionserver.RSRpcServices(1230): Open testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,731 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 77a9376ac9bcef2c010fc93c023006db from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:22,731 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,732 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts state from ENABLING to ENABLED 2014-06-15 07:46:22,733 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 77a9376ac9bcef2c010fc93c023006db from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:22,733 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/77a9376ac9bcef2c010fc93c023006db 2014-06-15 07:46:22,733 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(4462): Opening region: {ENCODED => 77a9376ac9bcef2c010fc93c023006db, NAME => 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:22,734 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/write-master:458120000000000 2014-06-15 07:46:22,734 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. service=VisibilityLabelsService 2014-06-15 07:46:22,734 DEBUG [AM.ZK.Worker-pool3-t15] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=77a9376ac9bcef2c010fc93c023006db, current_state={77a9376ac9bcef2c010fc93c023006db state=PENDING_OPEN, ts=1402818382725, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:22,734 INFO [RS_OPEN_REGION-asf008:57332-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:22,734 INFO [AM.ZK.Worker-pool3-t15] master.RegionStates(813): Transition {77a9376ac9bcef2c010fc93c023006db state=PENDING_OPEN, ts=1402818382725, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {77a9376ac9bcef2c010fc93c023006db state=OPENING, ts=1402818382734, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:22,734 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 77a9376ac9bcef2c010fc93c023006db 2014-06-15 07:46:22,734 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(646): Instantiated testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,739 INFO [StoreOpener-77a9376ac9bcef2c010fc93c023006db-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:22,740 INFO [StoreOpener-77a9376ac9bcef2c010fc93c023006db-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:22,741 DEBUG [StoreOpener-77a9376ac9bcef2c010fc93c023006db-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/info 2014-06-15 07:46:22,742 DEBUG [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db 2014-06-15 07:46:22,744 INFO [RS_OPEN_REGION-asf008:57332-2] regionserver.HRegion(747): Onlined 77a9376ac9bcef2c010fc93c023006db; next sequenceid=2 2014-06-15 07:46:22,744 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(643): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 77a9376ac9bcef2c010fc93c023006db 2014-06-15 07:46:22,745 INFO [PostOpenDeployTasks:77a9376ac9bcef2c010fc93c023006db] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,751 INFO [PostOpenDeployTasks:77a9376ac9bcef2c010fc93c023006db] catalog.MetaEditor(464): Updated row testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. with server=asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,751 DEBUG [PostOpenDeployTasks:77a9376ac9bcef2c010fc93c023006db] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,751 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(805): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioning 77a9376ac9bcef2c010fc93c023006db from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:22,754 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/77a9376ac9bcef2c010fc93c023006db 2014-06-15 07:46:22,754 DEBUG [RS_OPEN_REGION-asf008:57332-2] zookeeper.ZKAssign(880): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Transitioned node 77a9376ac9bcef2c010fc93c023006db from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:22,754 DEBUG [RS_OPEN_REGION-asf008:57332-2] coordination.ZkOpenRegionCoordination(91): Transitioned 77a9376ac9bcef2c010fc93c023006db to OPENED in zk on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,754 DEBUG [RS_OPEN_REGION-asf008:57332-2] handler.OpenRegionHandler(167): Opened testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,754 DEBUG [AM.ZK.Worker-pool3-t17] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,57332,1402818342381, region=77a9376ac9bcef2c010fc93c023006db, current_state={77a9376ac9bcef2c010fc93c023006db state=OPENING, ts=1402818382734, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:22,755 INFO [AM.ZK.Worker-pool3-t17] master.RegionStates(813): Transition {77a9376ac9bcef2c010fc93c023006db state=OPENING, ts=1402818382734, server=asf008.sp2.ygridcore.net,57332,1402818342381} to {77a9376ac9bcef2c010fc93c023006db state=OPEN, ts=1402818382755, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:22,755 DEBUG [AM.ZK.Worker-pool3-t17] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 77a9376ac9bcef2c010fc93c023006db from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:22,756 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/77a9376ac9bcef2c010fc93c023006db 2014-06-15 07:46:22,756 DEBUG [AM.ZK.Worker-pool3-t17] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 77a9376ac9bcef2c010fc93c023006db in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:22,756 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:22,757 DEBUG [AM.ZK.Worker-pool3-t17] master.AssignmentManager$4(1293): Znode testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. deleted, state: {77a9376ac9bcef2c010fc93c023006db state=OPEN, ts=1402818382755, server=asf008.sp2.ygridcore.net,57332,1402818342381} 2014-06-15 07:46:22,757 INFO [AM.ZK.Worker-pool3-t17] master.RegionStates(359): Onlined 77a9376ac9bcef2c010fc93c023006db on asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,780 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:22,780 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,783 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:22,783 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:22,784 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0086 connected 2014-06-15 07:46:22,787 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0086, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,801 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:22,801 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,802 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:22,802 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:22,804 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0087 connected 2014-06-15 07:46:22,816 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:22,816 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,819 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:22,819 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:22,820 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0088 connected 2014-06-15 07:46:22,823 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0088, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:22,826 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:22,830 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' 2014-06-15 07:46:22,831 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:22,831 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'acquire' 2014-06-15 07:46:22,831 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts', kicking off acquire phase on members. 2014-06-15 07:46:22,831 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,831 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,834 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,834 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,834 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,834 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,834 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,834 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,834 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,834 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,834 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,835 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,835 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,834 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,835 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:22,835 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,835 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,835 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,835 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:22,835 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,835 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,836 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,836 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,836 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,836 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:22,836 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,836 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:22,836 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' with timeout 60000ms 2014-06-15 07:46:22,836 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:22,836 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,837 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'acquire' stage 2014-06-15 07:46:22,837 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,837 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally acquired 2014-06-15 07:46:22,836 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,837 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts) in zk 2014-06-15 07:46:22,837 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,837 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,837 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' with timeout 60000ms 2014-06-15 07:46:22,837 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' with timeout 60000ms 2014-06-15 07:46:22,838 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:22,838 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:22,838 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'acquire' stage 2014-06-15 07:46:22,838 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'acquire' stage 2014-06-15 07:46:22,838 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally acquired 2014-06-15 07:46:22,838 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts) in zk 2014-06-15 07:46:22,838 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:22,838 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:22,838 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool151-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,839 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool151-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. started... 2014-06-15 07:46:22,839 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool151-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db., current region memstore size 640 B 2014-06-15 07:46:22,840 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,841 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,841 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,841 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:22,842 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,842 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:22,856 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:22,856 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741929_1105 size 5101 2014-06-15 07:46:22,858 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool151-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=640, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/.tmp/a1be4ebe795e4c73baee3e10f876991f 2014-06-15 07:46:22,865 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool151-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/.tmp/a1be4ebe795e4c73baee3e10f876991f as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/info/a1be4ebe795e4c73baee3e10f876991f 2014-06-15 07:46:22,873 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool151-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/info/a1be4ebe795e4c73baee3e10f876991f, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:22,873 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool151-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~640 B/640, currentsize=0 B/0 for region testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. in 34ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:22,873 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool151-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:22,874 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:22,874 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:22,874 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,874 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally acquired 2014-06-15 07:46:22,874 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts) in zk 2014-06-15 07:46:22,875 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,875 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,876 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,876 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,876 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:22,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:22,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:22,876 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:22,877 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,877 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,877 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,877 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,878 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:22,878 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:22,878 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' on coordinator 2014-06-15 07:46:22,878 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1010ce3[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:22,878 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'in-barrier' execution. 2014-06-15 07:46:22,878 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,879 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,879 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,879 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,880 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,880 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,880 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,880 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,880 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' received 'reached' from coordinator. 2014-06-15 07:46:22,880 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,880 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally completed 2014-06-15 07:46:22,879 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,880 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:22,881 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,880 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' received 'reached' from coordinator. 2014-06-15 07:46:22,881 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' received 'reached' from coordinator. 2014-06-15 07:46:22,881 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally completed 2014-06-15 07:46:22,881 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally completed 2014-06-15 07:46:22,881 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:22,881 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:22,881 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,881 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:22,881 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:22,883 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' has notified controller of completion 2014-06-15 07:46:22,883 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,883 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:22,883 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed. 2014-06-15 07:46:22,884 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' has notified controller of completion 2014-06-15 07:46:22,884 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,884 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed. 2014-06-15 07:46:22,890 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' has notified controller of completion 2014-06-15 07:46:22,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,890 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,890 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed. 2014-06-15 07:46:22,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:22,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:22,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,891 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,892 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,892 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,892 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:22,892 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,893 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:22,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:22,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:22,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,893 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:22,894 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:22,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:22,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:22,895 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:22,896 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:22,896 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' execution completed 2014-06-15 07:46:22,896 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:22,896 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:22,896 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:22,896 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPutsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:22,896 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts', counting down latch. Waiting for 0 more 2014-06-15 07:46:22,901 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,901 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,901 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,901 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,901 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:22,901 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:22,901 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:22,905 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:22,905 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' 2014-06-15 07:46:22,906 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:22,906 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:22,906 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:23,006 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:23,008 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:23,009 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0087, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,020 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:23,021 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,022 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:23,022 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:23,024 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0089 connected 2014-06-15 07:46:23,035 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:23,035 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,039 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:23,039 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:23,040 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008a connected 2014-06-15 07:46:23,044 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,050 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:23,055 DEBUG [RpcServer.handler=0,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:23,055 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' 2014-06-15 07:46:23,055 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:23,055 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'acquire' 2014-06-15 07:46:23,055 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts', kicking off acquire phase on members. 2014-06-15 07:46:23,056 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,056 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,058 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,058 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,058 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,058 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,058 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,058 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,058 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,059 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,059 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,059 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:23,058 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,059 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,059 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,059 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,059 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,059 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,060 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,060 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:23,060 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:23,060 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,060 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,060 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,060 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,061 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,061 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:23,061 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,061 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,061 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts is still present, removing 2014-06-15 07:46:23,061 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,061 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts is still present, removing 2014-06-15 07:46:23,062 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' with timeout 60000ms 2014-06-15 07:46:23,062 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,062 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:23,062 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' with timeout 60000ms 2014-06-15 07:46:23,062 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:23,062 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'acquire' stage 2014-06-15 07:46:23,062 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally acquired 2014-06-15 07:46:23,061 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts is still present, removing 2014-06-15 07:46:23,062 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts) in zk 2014-06-15 07:46:23,062 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,062 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'acquire' stage 2014-06-15 07:46:23,063 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally acquired 2014-06-15 07:46:23,063 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts) in zk 2014-06-15 07:46:23,063 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' with timeout 60000ms 2014-06-15 07:46:23,063 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:23,063 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'acquire' stage 2014-06-15 07:46:23,064 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,064 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:23,064 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:23,064 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:23,064 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. started... 2014-06-15 07:46:23,064 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,065 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db., current region memstore size 256 B 2014-06-15 07:46:23,065 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,065 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,065 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:23,065 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:23,093 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:23,094 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:23,097 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=18, memsize=256, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/.tmp/6d8c2efbd96c4424a6717a2f67d68bd0 2014-06-15 07:46:23,107 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d8c2efbd96c4424a6717a2f67d68bd0 2014-06-15 07:46:23,110 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/.tmp/6d8c2efbd96c4424a6717a2f67d68bd0 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/info/6d8c2efbd96c4424a6717a2f67d68bd0 2014-06-15 07:46:23,121 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d8c2efbd96c4424a6717a2f67d68bd0 2014-06-15 07:46:23,121 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/77a9376ac9bcef2c010fc93c023006db/info/6d8c2efbd96c4424a6717a2f67d68bd0, entries=2, sequenceid=18, filesize=5.0 K 2014-06-15 07:46:23,121 INFO [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~256 B/256, currentsize=0 B/0 for region testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. in 56ms, sequenceid=18, compaction requested=false 2014-06-15 07:46:23,121 DEBUG [rs(asf008.sp2.ygridcore.net,57332,1402818342381)-flush-proc-pool155-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:23,122 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:23,122 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:23,122 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,122 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally acquired 2014-06-15 07:46:23,122 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts) in zk 2014-06-15 07:46:23,124 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,124 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,124 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:23,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:23,124 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,125 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:23,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:23,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,126 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,126 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:23,131 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:23,132 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' on coordinator 2014-06-15 07:46:23,132 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@7d3146[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:23,132 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' starting 'in-barrier' execution. 2014-06-15 07:46:23,132 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,133 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,133 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,134 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,134 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,134 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,134 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,134 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,134 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' received 'reached' from coordinator. 2014-06-15 07:46:23,134 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally completed 2014-06-15 07:46:23,134 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,134 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:23,135 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' received 'reached' from coordinator. 2014-06-15 07:46:23,135 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally completed 2014-06-15 07:46:23,135 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:23,133 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,135 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,135 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' received 'reached' from coordinator. 2014-06-15 07:46:23,135 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' locally completed 2014-06-15 07:46:23,135 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:23,134 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,135 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:23,136 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:23,137 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' has notified controller of completion 2014-06-15 07:46:23,137 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' has notified controller of completion 2014-06-15 07:46:23,137 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:23,137 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:23,137 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed. 2014-06-15 07:46:23,137 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed. 2014-06-15 07:46:23,137 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:23,138 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' has notified controller of completion 2014-06-15 07:46:23,138 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,138 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:23,139 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' completed. 2014-06-15 07:46:23,139 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,139 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,140 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,140 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:23,140 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:23,140 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,141 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,142 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:23,142 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,142 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:23,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:23,142 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:23,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,143 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,144 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:23,144 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:23,144 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,144 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,145 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,145 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,145 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' member 'asf008.sp2.ygridcore.net,57332,1402818342381': 2014-06-15 07:46:23,145 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' released barrier for procedure'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts', counting down latch. Waiting for 0 more 2014-06-15 07:46:23,145 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' execution completed 2014-06-15 07:46:23,145 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:23,145 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:23,145 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts 2014-06-15 07:46:23,146 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPutsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:23,158 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,158 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,158 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,158 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,159 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,159 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,159 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,158 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,159 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,165 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:23,165 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts' 2014-06-15 07:46:23,165 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:23,166 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:23,166 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:23,266 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:23,268 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:23,268 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0089, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,300 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts Thread=379 (was 379), OpenFileDescriptor=595 (was 598), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=597 (was 597), ProcessCount=176 (was 176), AvailableMemoryMB=3207 (was 3276), ConnectionCount=8 (was 8) 2014-06-15 07:46:23,324 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice Thread=380, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=597, ProcessCount=176, AvailableMemoryMB=3206, ConnectionCount=8 2014-06-15 07:46:23,356 DEBUG [RpcServer.handler=3,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:23,359 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:23,362 INFO [RpcServer.handler=2,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:23,369 DEBUG [RpcServer.handler=2,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/write-master:458120000000000 2014-06-15 07:46:23,375 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,390 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:23,391 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741931_1107 size 341 2014-06-15 07:46:23,397 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:23,399 INFO [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice HTD == 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,417 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:23,417 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:23,419 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(646): Instantiated testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,420 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(1116): Closing testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6.: disabling compactions & flushes 2014-06-15 07:46:23,420 DEBUG [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,420 INFO [RegionOpenAndInitThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice-1] regionserver.HRegion(1225): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,427 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:23,427 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,427 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node f0b89e02464e5bd1522958b344a3c7c6 with OFFLINE state 2014-06-15 07:46:23,430 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:23,430 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={f0b89e02464e5bd1522958b344a3c7c6 state=OFFLINE, ts=1402818383427, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,430 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={f0b89e02464e5bd1522958b344a3c7c6 state=OFFLINE, ts=1402818383427, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,432 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:23,432 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {f0b89e02464e5bd1522958b344a3c7c6 state=OFFLINE, ts=1402818383427, server=null} to {f0b89e02464e5bd1522958b344a3c7c6 state=PENDING_OPEN, ts=1402818383432, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:23,433 INFO [Priority.RpcServer.handler=1,port=47197] regionserver.RSRpcServices(1230): Open testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,438 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning f0b89e02464e5bd1522958b344a3c7c6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:23,438 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,439 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice state from ENABLING to ENABLED 2014-06-15 07:46:23,442 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f0b89e02464e5bd1522958b344a3c7c6 2014-06-15 07:46:23,443 DEBUG [AM.ZK.Worker-pool3-t20] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=f0b89e02464e5bd1522958b344a3c7c6, current_state={f0b89e02464e5bd1522958b344a3c7c6 state=PENDING_OPEN, ts=1402818383432, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:23,443 INFO [AM.ZK.Worker-pool3-t20] master.RegionStates(813): Transition {f0b89e02464e5bd1522958b344a3c7c6 state=PENDING_OPEN, ts=1402818383432, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {f0b89e02464e5bd1522958b344a3c7c6 state=OPENING, ts=1402818383443, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:23,443 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node f0b89e02464e5bd1522958b344a3c7c6 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:23,444 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(4462): Opening region: {ENCODED => f0b89e02464e5bd1522958b344a3c7c6, NAME => 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:23,444 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/write-master:458120000000000 2014-06-15 07:46:23,445 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. service=VisibilityLabelsService 2014-06-15 07:46:23,445 INFO [RS_OPEN_REGION-asf008:47197-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:23,445 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice f0b89e02464e5bd1522958b344a3c7c6 2014-06-15 07:46:23,445 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(646): Instantiated testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,452 INFO [StoreOpener-f0b89e02464e5bd1522958b344a3c7c6-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:23,452 INFO [StoreOpener-f0b89e02464e5bd1522958b344a3c7c6-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:23,454 DEBUG [StoreOpener-f0b89e02464e5bd1522958b344a3c7c6-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/info 2014-06-15 07:46:23,455 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6 2014-06-15 07:46:23,457 INFO [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(747): Onlined f0b89e02464e5bd1522958b344a3c7c6; next sequenceid=2 2014-06-15 07:46:23,457 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node f0b89e02464e5bd1522958b344a3c7c6 2014-06-15 07:46:23,458 INFO [PostOpenDeployTasks:f0b89e02464e5bd1522958b344a3c7c6] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,490 INFO [PostOpenDeployTasks:f0b89e02464e5bd1522958b344a3c7c6] catalog.MetaEditor(464): Updated row testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,490 DEBUG [PostOpenDeployTasks:f0b89e02464e5bd1522958b344a3c7c6] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,490 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning f0b89e02464e5bd1522958b344a3c7c6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:23,493 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node f0b89e02464e5bd1522958b344a3c7c6 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:23,493 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/f0b89e02464e5bd1522958b344a3c7c6 2014-06-15 07:46:23,493 DEBUG [RS_OPEN_REGION-asf008:47197-1] coordination.ZkOpenRegionCoordination(91): Transitioned f0b89e02464e5bd1522958b344a3c7c6 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,494 DEBUG [RS_OPEN_REGION-asf008:47197-1] handler.OpenRegionHandler(167): Opened testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,494 DEBUG [AM.ZK.Worker-pool3-t2] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=f0b89e02464e5bd1522958b344a3c7c6, current_state={f0b89e02464e5bd1522958b344a3c7c6 state=OPENING, ts=1402818383443, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:23,494 INFO [AM.ZK.Worker-pool3-t2] master.RegionStates(813): Transition {f0b89e02464e5bd1522958b344a3c7c6 state=OPENING, ts=1402818383443, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {f0b89e02464e5bd1522958b344a3c7c6 state=OPEN, ts=1402818383494, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:23,495 DEBUG [AM.ZK.Worker-pool3-t2] coordination.ZkOpenRegionCoordination(350): Handling OPENED of f0b89e02464e5bd1522958b344a3c7c6 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:23,497 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/f0b89e02464e5bd1522958b344a3c7c6 2014-06-15 07:46:23,497 DEBUG [AM.ZK.Worker-pool3-t2] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node f0b89e02464e5bd1522958b344a3c7c6 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:23,497 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:23,497 DEBUG [AM.ZK.Worker-pool3-t2] master.AssignmentManager$4(1293): Znode testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. deleted, state: {f0b89e02464e5bd1522958b344a3c7c6 state=OPEN, ts=1402818383494, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:23,497 INFO [AM.ZK.Worker-pool3-t2] master.RegionStates(359): Onlined f0b89e02464e5bd1522958b344a3c7c6 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,689 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:23,690 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,691 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:23,691 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:23,693 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008b connected 2014-06-15 07:46:23,695 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,711 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:23,712 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,713 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:23,713 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:23,714 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008c connected 2014-06-15 07:46:23,726 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:23,726 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,728 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:23,728 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:23,729 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008d connected 2014-06-15 07:46:23,733 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:23,736 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:23,747 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' 2014-06-15 07:46:23,747 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:23,747 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' starting 'acquire' 2014-06-15 07:46:23,747 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice', kicking off acquire phase on members. 2014-06-15 07:46:23,748 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,748 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,756 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,756 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,756 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,757 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,757 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,757 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:23,757 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,756 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:23,756 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,757 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:23,757 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,757 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:23,758 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,758 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,758 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,758 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,758 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,759 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,759 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:23,759 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,759 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:23,759 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,759 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:23,759 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,759 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,760 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,760 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,760 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,760 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,760 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' with timeout 60000ms 2014-06-15 07:46:23,760 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' with timeout 60000ms 2014-06-15 07:46:23,760 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,760 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:23,760 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' with timeout 60000ms 2014-06-15 07:46:23,760 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' starting 'acquire' stage 2014-06-15 07:46:23,761 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:23,761 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' locally acquired 2014-06-15 07:46:23,761 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' starting 'acquire' stage 2014-06-15 07:46:23,761 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice) in zk 2014-06-15 07:46:23,760 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:23,761 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:23,761 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' starting 'acquire' stage 2014-06-15 07:46:23,761 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:23,761 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' locally acquired 2014-06-15 07:46:23,762 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice) in zk 2014-06-15 07:46:23,762 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool158-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,762 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool158-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. started... 2014-06-15 07:46:23,763 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool158-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6., current region memstore size 712 B 2014-06-15 07:46:23,763 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,765 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,765 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,765 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:23,766 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,766 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:23,944 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:23,945 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741933_1109 size 5165 2014-06-15 07:46:23,959 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool158-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/.tmp/04b8ac337ee64eca80c43e260c1255bf 2014-06-15 07:46:23,967 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool158-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/.tmp/04b8ac337ee64eca80c43e260c1255bf as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/info/04b8ac337ee64eca80c43e260c1255bf 2014-06-15 07:46:23,976 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool158-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/info/04b8ac337ee64eca80c43e260c1255bf, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:23,976 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool158-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. in 213ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:23,976 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool158-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:23,977 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:23,977 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:23,977 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,977 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' locally acquired 2014-06-15 07:46:23,977 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice) in zk 2014-06-15 07:46:23,982 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,982 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,982 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,982 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,982 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,982 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:23,982 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:23,982 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,983 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:23,983 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:23,983 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,983 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,983 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,984 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,984 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:23,984 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:23,985 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' on coordinator 2014-06-15 07:46:23,985 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@ff8e3a[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:23,985 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' starting 'in-barrier' execution. 2014-06-15 07:46:23,985 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,986 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,986 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,986 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,986 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,986 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,987 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,987 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' received 'reached' from coordinator. 2014-06-15 07:46:23,987 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,987 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' locally completed 2014-06-15 07:46:23,987 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:23,987 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:23,987 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:23,986 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,987 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,987 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' received 'reached' from coordinator. 2014-06-15 07:46:23,988 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:23,988 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' locally completed 2014-06-15 07:46:23,987 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,988 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:23,988 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,988 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,988 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' received 'reached' from coordinator. 2014-06-15 07:46:23,988 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' locally completed 2014-06-15 07:46:23,988 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:23,989 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,990 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' has notified controller of completion 2014-06-15 07:46:23,990 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:23,990 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' completed. 2014-06-15 07:46:23,993 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' has notified controller of completion 2014-06-15 07:46:23,993 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,993 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:23,994 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' completed. 2014-06-15 07:46:23,994 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' has notified controller of completion 2014-06-15 07:46:23,994 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,994 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:23,994 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' completed. 2014-06-15 07:46:23,994 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:23,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:23,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,995 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,996 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:23,996 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,996 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:23,996 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:23,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:23,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,997 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,998 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:23,998 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:23,999 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:23,999 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:23,999 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:23,999 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:23,999 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,000 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:24,000 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:24,000 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice', counting down latch. Waiting for 0 more 2014-06-15 07:46:24,000 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' execution completed 2014-06-15 07:46:24,000 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:24,000 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:24,001 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice 2014-06-15 07:46:24,001 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwiceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:24,009 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,009 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,009 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,009 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,009 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,009 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,010 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,010 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,010 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,019 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:24,019 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice' 2014-06-15 07:46:24,019 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:24,019 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:24,019 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:24,120 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:24,121 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:24,121 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,171 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice Thread=378 (was 380), OpenFileDescriptor=598 (was 597) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=573 (was 597), ProcessCount=176 (was 176), AvailableMemoryMB=3166 (was 3206), ConnectionCount=8 (was 8) 2014-06-15 07:46:24,195 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilyWithoutCellVisibilityWithMulipleVersions Thread=379, OpenFileDescriptor=600, MaxFileDescriptor=60000, SystemLoadAverage=573, ProcessCount=176, AvailableMemoryMB=3166, ConnectionCount=8 2014-06-15 07:46:24,566 DEBUG [RpcServer.handler=3,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:24,567 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:24,570 INFO [RpcServer.handler=4,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:24,574 DEBUG [RpcServer.handler=4,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/write-master:458120000000000 2014-06-15 07:46:24,587 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,602 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:24,603 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741934_1110 size 336 2014-06-15 07:46:24,615 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:24,617 INFO [RegionOpenAndInitThread-testDeleteFamilyWithoutCellVisibilityWithMulipleVersions-1] regionserver.HRegion(4277): creating HRegion testDeleteFamilyWithoutCellVisibilityWithMulipleVersions HTD == 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,640 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:24,641 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:24,644 DEBUG [RegionOpenAndInitThread-testDeleteFamilyWithoutCellVisibilityWithMulipleVersions-1] regionserver.HRegion(646): Instantiated testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,644 DEBUG [RegionOpenAndInitThread-testDeleteFamilyWithoutCellVisibilityWithMulipleVersions-1] regionserver.HRegion(1116): Closing testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee.: disabling compactions & flushes 2014-06-15 07:46:24,644 DEBUG [RegionOpenAndInitThread-testDeleteFamilyWithoutCellVisibilityWithMulipleVersions-1] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,644 INFO [RegionOpenAndInitThread-testDeleteFamilyWithoutCellVisibilityWithMulipleVersions-1] regionserver.HRegion(1225): Closed testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,649 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:24,649 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,649 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node d0cb8a652f5700a89ec7c2b5cefb95ee with OFFLINE state 2014-06-15 07:46:24,650 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:24,650 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={d0cb8a652f5700a89ec7c2b5cefb95ee state=OFFLINE, ts=1402818384649, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,651 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={d0cb8a652f5700a89ec7c2b5cefb95ee state=OFFLINE, ts=1402818384649, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,654 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:24,655 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {d0cb8a652f5700a89ec7c2b5cefb95ee state=OFFLINE, ts=1402818384649, server=null} to {d0cb8a652f5700a89ec7c2b5cefb95ee state=PENDING_OPEN, ts=1402818384655, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:24,655 INFO [Priority.RpcServer.handler=2,port=47197] regionserver.RSRpcServices(1230): Open testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,660 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning d0cb8a652f5700a89ec7c2b5cefb95ee from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:24,660 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,660 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteFamilyWithoutCellVisibilityWithMulipleVersions state from ENABLING to ENABLED 2014-06-15 07:46:24,662 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d0cb8a652f5700a89ec7c2b5cefb95ee 2014-06-15 07:46:24,662 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node d0cb8a652f5700a89ec7c2b5cefb95ee from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:24,663 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(4462): Opening region: {ENCODED => d0cb8a652f5700a89ec7c2b5cefb95ee, NAME => 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:24,663 DEBUG [AM.ZK.Worker-pool3-t5] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=d0cb8a652f5700a89ec7c2b5cefb95ee, current_state={d0cb8a652f5700a89ec7c2b5cefb95ee state=PENDING_OPEN, ts=1402818384655, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:24,663 INFO [AM.ZK.Worker-pool3-t5] master.RegionStates(813): Transition {d0cb8a652f5700a89ec7c2b5cefb95ee state=PENDING_OPEN, ts=1402818384655, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {d0cb8a652f5700a89ec7c2b5cefb95ee state=OPENING, ts=1402818384663, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:24,663 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. service=VisibilityLabelsService 2014-06-15 07:46:24,663 INFO [RS_OPEN_REGION-asf008:47197-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:24,664 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteFamilyWithoutCellVisibilityWithMulipleVersions d0cb8a652f5700a89ec7c2b5cefb95ee 2014-06-15 07:46:24,664 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(646): Instantiated testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,665 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/write-master:458120000000000 2014-06-15 07:46:24,669 INFO [StoreOpener-d0cb8a652f5700a89ec7c2b5cefb95ee-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:24,670 INFO [StoreOpener-d0cb8a652f5700a89ec7c2b5cefb95ee-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:24,671 DEBUG [StoreOpener-d0cb8a652f5700a89ec7c2b5cefb95ee-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/info 2014-06-15 07:46:24,672 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee 2014-06-15 07:46:24,673 INFO [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(747): Onlined d0cb8a652f5700a89ec7c2b5cefb95ee; next sequenceid=2 2014-06-15 07:46:24,673 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node d0cb8a652f5700a89ec7c2b5cefb95ee 2014-06-15 07:46:24,674 INFO [PostOpenDeployTasks:d0cb8a652f5700a89ec7c2b5cefb95ee] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,678 INFO [PostOpenDeployTasks:d0cb8a652f5700a89ec7c2b5cefb95ee] catalog.MetaEditor(464): Updated row testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,678 DEBUG [PostOpenDeployTasks:d0cb8a652f5700a89ec7c2b5cefb95ee] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,678 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning d0cb8a652f5700a89ec7c2b5cefb95ee from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:24,679 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node d0cb8a652f5700a89ec7c2b5cefb95ee from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:24,679 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/d0cb8a652f5700a89ec7c2b5cefb95ee 2014-06-15 07:46:24,679 DEBUG [RS_OPEN_REGION-asf008:47197-2] coordination.ZkOpenRegionCoordination(91): Transitioned d0cb8a652f5700a89ec7c2b5cefb95ee to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,679 DEBUG [RS_OPEN_REGION-asf008:47197-2] handler.OpenRegionHandler(167): Opened testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,679 DEBUG [AM.ZK.Worker-pool3-t7] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=d0cb8a652f5700a89ec7c2b5cefb95ee, current_state={d0cb8a652f5700a89ec7c2b5cefb95ee state=OPENING, ts=1402818384663, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:24,680 INFO [AM.ZK.Worker-pool3-t7] master.RegionStates(813): Transition {d0cb8a652f5700a89ec7c2b5cefb95ee state=OPENING, ts=1402818384663, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {d0cb8a652f5700a89ec7c2b5cefb95ee state=OPEN, ts=1402818384680, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:24,680 DEBUG [AM.ZK.Worker-pool3-t7] coordination.ZkOpenRegionCoordination(350): Handling OPENED of d0cb8a652f5700a89ec7c2b5cefb95ee from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:24,681 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/d0cb8a652f5700a89ec7c2b5cefb95ee 2014-06-15 07:46:24,681 DEBUG [AM.ZK.Worker-pool3-t7] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node d0cb8a652f5700a89ec7c2b5cefb95ee in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:24,681 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:24,681 DEBUG [AM.ZK.Worker-pool3-t7] master.AssignmentManager$4(1293): Znode testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. deleted, state: {d0cb8a652f5700a89ec7c2b5cefb95ee state=OPEN, ts=1402818384680, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:24,681 INFO [AM.ZK.Worker-pool3-t7] master.RegionStates(359): Onlined d0cb8a652f5700a89ec7c2b5cefb95ee on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,697 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:24,697 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,698 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:24,698 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:24,700 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008e connected 2014-06-15 07:46:24,701 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,717 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:24,717 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,719 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:24,719 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:24,720 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008f connected 2014-06-15 07:46:24,729 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:24,729 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,730 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:24,731 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:24,732 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0090 connected 2014-06-15 07:46:24,734 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0090, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,737 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:24,742 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' 2014-06-15 07:46:24,742 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:24,742 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' 2014-06-15 07:46:24,742 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:24,742 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,743 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,744 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,744 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,744 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,744 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,744 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,744 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,745 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,745 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,744 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,745 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,745 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,744 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,745 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,745 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,745 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:24,745 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,746 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:24,746 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,747 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:24,746 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:24,747 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:24,747 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:24,747 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool159-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:24,748 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:24,748 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:24,748 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:24,747 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:24,748 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:24,748 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool159-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. started... 2014-06-15 07:46:24,749 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool159-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee., current region memstore size 640 B 2014-06-15 07:46:24,750 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,751 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,751 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,751 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:24,751 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,751 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:24,768 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:24,769 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741936_1112 size 5101 2014-06-15 07:46:24,771 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool159-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=640, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/.tmp/a19f46f05b77481ebfe90c7efcb499e6 2014-06-15 07:46:24,781 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool159-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/.tmp/a19f46f05b77481ebfe90c7efcb499e6 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/info/a19f46f05b77481ebfe90c7efcb499e6 2014-06-15 07:46:24,789 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool159-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/info/a19f46f05b77481ebfe90c7efcb499e6, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:24,789 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool159-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~640 B/640, currentsize=0 B/0 for region testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. in 40ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:24,789 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool159-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,789 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:24,789 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:24,790 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,790 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:24,790 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:24,791 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,791 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,791 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,791 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,791 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,791 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:24,791 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:24,791 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,792 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:24,792 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:24,792 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,792 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:24,792 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,793 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:24,793 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:24,793 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:24,793 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' on coordinator 2014-06-15 07:46:24,793 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@18d1538[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:24,793 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:24,794 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,795 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,795 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,795 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,795 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,795 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,795 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,795 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,795 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,795 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,796 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:24,796 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:24,796 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:24,796 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:24,796 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:24,796 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:24,796 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:24,797 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:24,797 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:24,796 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:24,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:24,797 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:24,798 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:24,798 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:24,798 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:24,798 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:24,798 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,798 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:24,799 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:24,799 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:24,799 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:24,799 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:24,799 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:24,799 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:24,803 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:24,803 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:24,803 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,803 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:24,804 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,804 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:24,804 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:24,805 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,805 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,805 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,805 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,805 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:24,805 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:24,805 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:24,805 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,806 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:24,806 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,806 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:24,806 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:24,807 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:24,807 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,807 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:24,807 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,807 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:24,808 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:24,808 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:24,808 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' execution completed 2014-06-15 07:46:24,808 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:24,808 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:24,808 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,808 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilyWithoutCellVisibilityWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:24,837 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,837 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,837 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,837 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,837 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,837 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,837 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,837 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,838 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,843 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:24,843 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' 2014-06-15 07:46:24,844 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:24,844 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilyWithoutCellVisibilityWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:24,844 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:24,944 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:24,946 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:24,946 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a008f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,952 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:24,952 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,953 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:24,954 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:24,955 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0091 connected 2014-06-15 07:46:24,963 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:24,964 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,965 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:24,965 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:24,966 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0092 connected 2014-06-15 07:46:24,968 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0092, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:24,970 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:24,973 DEBUG [RpcServer.handler=0,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteFamilyWithoutCellVisibilityWithMulipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:24,973 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' 2014-06-15 07:46:24,973 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:24,973 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' 2014-06-15 07:46:24,974 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:24,974 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,974 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,975 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,975 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,975 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,975 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:24,976 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,976 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:24,976 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,976 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:24,976 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,976 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:24,976 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,976 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:24,976 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,977 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,977 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,977 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,977 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,977 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,977 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,978 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyWithoutCellVisibilityWithMulipleVersions is still present, removing 2014-06-15 07:46:24,978 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,978 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyWithoutCellVisibilityWithMulipleVersions is still present, removing 2014-06-15 07:46:24,978 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:24,979 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:24,979 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyWithoutCellVisibilityWithMulipleVersions is still present, removing 2014-06-15 07:46:24,979 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,979 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool162-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:24,980 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:24,980 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool162-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. started... 2014-06-15 07:46:24,980 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:24,980 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool162-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee., current region memstore size 128 B 2014-06-15 07:46:24,980 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:24,980 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:24,979 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:24,980 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:24,982 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,983 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,983 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,983 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:24,984 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:24,984 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:24,996 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:24,997 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741937_1113 size 4941 2014-06-15 07:46:24,999 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool162-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=128, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/.tmp/51aee4cfaedf42f0a503c4ca4342379e 2014-06-15 07:46:25,008 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool162-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/.tmp/51aee4cfaedf42f0a503c4ca4342379e as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/info/51aee4cfaedf42f0a503c4ca4342379e 2014-06-15 07:46:25,020 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool162-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/info/51aee4cfaedf42f0a503c4ca4342379e, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:46:25,021 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool162-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~128 B/128, currentsize=0 B/0 for region testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. in 41ms, sequenceid=16, compaction requested=false 2014-06-15 07:46:25,021 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool162-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:25,021 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:25,021 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:25,021 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,021 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:25,021 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:25,022 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,023 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,023 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,023 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,023 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:25,023 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,025 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' on coordinator 2014-06-15 07:46:25,025 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1b525d8[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:25,025 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:25,025 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,027 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,027 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,027 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,027 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,028 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,028 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,028 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,028 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,028 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:25,028 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:25,028 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:25,028 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:25,028 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,027 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,029 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,029 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:25,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,029 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:25,030 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:25,030 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,030 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:25,031 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:25,031 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,031 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:25,032 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:25,032 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,032 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:25,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,036 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:25,036 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,036 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,038 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,038 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,038 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,039 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,039 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,039 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,039 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,040 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,040 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:25,040 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:25,040 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' execution completed 2014-06-15 07:46:25,040 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:25,040 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:25,040 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,041 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilyWithoutCellVisibilityWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:25,047 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,047 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,047 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,047 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,047 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,047 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,047 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,048 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,053 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,053 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' 2014-06-15 07:46:25,053 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:25,055 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilyWithoutCellVisibilityWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:25,055 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:25,155 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:25,157 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:25,158 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0091, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,167 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:25,167 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,182 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:25,183 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0093 connected 2014-06-15 07:46:25,184 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0093, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:25,210 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:25,210 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,215 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:25,215 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:25,217 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0094 connected 2014-06-15 07:46:25,220 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0094, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,225 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:25,230 DEBUG [RpcServer.handler=2,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteFamilyWithoutCellVisibilityWithMulipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:25,231 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' 2014-06-15 07:46:25,231 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:25,231 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' 2014-06-15 07:46:25,231 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:25,232 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,232 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,233 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,233 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,233 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,234 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,234 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,233 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,234 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,234 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,234 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,234 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,235 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:25,235 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:25,235 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:25,236 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyWithoutCellVisibilityWithMulipleVersions is still present, removing 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,237 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,236 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,237 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyWithoutCellVisibilityWithMulipleVersions is still present, removing 2014-06-15 07:46:25,237 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:25,237 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,237 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:25,237 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:25,237 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:25,237 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:25,238 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:25,238 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:25,238 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:25,238 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. started... 2014-06-15 07:46:25,237 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,238 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee., current region memstore size 120 B 2014-06-15 07:46:25,238 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:25,239 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:25,239 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:25,239 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteFamilyWithoutCellVisibilityWithMulipleVersions is still present, removing 2014-06-15 07:46:25,239 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,239 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' with timeout 60000ms 2014-06-15 07:46:25,239 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:25,239 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'acquire' stage 2014-06-15 07:46:25,239 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:25,240 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:25,241 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,242 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,242 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:25,244 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,244 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,244 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:25,266 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:25,268 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741938_1114 size 5109 2014-06-15 07:46:25,280 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=120, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/.tmp/b204a41390c749e4b6c106d59c595f67 2014-06-15 07:46:25,290 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b204a41390c749e4b6c106d59c595f67 2014-06-15 07:46:25,294 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/.tmp/b204a41390c749e4b6c106d59c595f67 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/info/b204a41390c749e4b6c106d59c595f67 2014-06-15 07:46:25,318 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b204a41390c749e4b6c106d59c595f67 2014-06-15 07:46:25,318 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/d0cb8a652f5700a89ec7c2b5cefb95ee/info/b204a41390c749e4b6c106d59c595f67, entries=1, sequenceid=19, filesize=5.0 K 2014-06-15 07:46:25,319 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~120 B/120, currentsize=0 B/0 for region testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. in 81ms, sequenceid=19, compaction requested=true 2014-06-15 07:46:25,319 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool165-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:25,319 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:25,319 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:25,319 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,319 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally acquired 2014-06-15 07:46:25,319 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteFamilyWithoutCellVisibilityWithMulipleVersions) in zk 2014-06-15 07:46:25,322 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,322 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,322 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,322 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,323 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:25,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,323 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,324 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,325 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,325 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,325 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,326 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,326 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' on coordinator 2014-06-15 07:46:25,326 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@3384c0[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:25,326 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:25,326 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,328 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,328 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,328 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,328 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,328 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,328 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,328 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,329 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,329 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,329 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:25,329 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,329 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:25,329 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:25,329 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:25,328 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,329 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,329 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,329 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,329 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,329 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' locally completed 2014-06-15 07:46:25,330 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,330 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:25,330 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,331 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:25,331 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,331 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:25,333 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:25,333 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,333 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' has notified controller of completion 2014-06-15 07:46:25,333 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:25,334 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,334 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' completed. 2014-06-15 07:46:25,334 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,334 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,335 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,335 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,335 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,336 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,336 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,337 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,337 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,337 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,338 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:25,338 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,338 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,338 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,338 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteFamilyWithoutCellVisibilityWithMulipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,338 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,338 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,338 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,339 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,339 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,339 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,339 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,340 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,340 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,341 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,341 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,341 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,343 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,344 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:25,344 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:25,344 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' execution completed 2014-06-15 07:46:25,344 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:25,344 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:25,345 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteFamilyWithoutCellVisibilityWithMulipleVersions 2014-06-15 07:46:25,345 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteFamilyWithoutCellVisibilityWithMulipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:25,354 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,354 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,354 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,354 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,354 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,354 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,354 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,355 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,355 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,362 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,365 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteFamilyWithoutCellVisibilityWithMulipleVersions' 2014-06-15 07:46:25,365 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:25,366 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteFamilyWithoutCellVisibilityWithMulipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:25,366 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:25,466 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:25,468 DEBUG [RpcServer.handler=3,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:25,468 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0093, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,498 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteFamilyWithoutCellVisibilityWithMulipleVersions Thread=379 (was 379), OpenFileDescriptor=599 (was 600), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=573 (was 573), ProcessCount=176 (was 176), AvailableMemoryMB=2945 (was 3166), ConnectionCount=8 (was 8) 2014-06-15 07:46:25,522 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnWithLatestTimeStampUsingMultipleVersions Thread=380, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=573, ProcessCount=176, AvailableMemoryMB=2940, ConnectionCount=8 2014-06-15 07:46:25,561 DEBUG [RpcServer.handler=4,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:25,566 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:25,570 INFO [RpcServer.handler=1,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:25,593 DEBUG [RpcServer.handler=1,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/write-master:458120000000000 2014-06-15 07:46:25,605 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,631 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:25,632 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741939_1115 size 336 2014-06-15 07:46:25,641 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:25,643 INFO [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersions-1] regionserver.HRegion(4277): creating HRegion testDeleteColumnWithLatestTimeStampUsingMultipleVersions HTD == 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,665 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:25,666 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:25,668 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersions-1] regionserver.HRegion(646): Instantiated testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,669 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersions-1] regionserver.HRegion(1116): Closing testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2.: disabling compactions & flushes 2014-06-15 07:46:25,669 DEBUG [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersions-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,669 INFO [RegionOpenAndInitThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersions-1] regionserver.HRegion(1225): Closed testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,674 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:25,674 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,674 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 8777fa63e8acbc235fb1bf153d3b19d2 with OFFLINE state 2014-06-15 07:46:25,676 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:25,676 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={8777fa63e8acbc235fb1bf153d3b19d2 state=OFFLINE, ts=1402818385674, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,676 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={8777fa63e8acbc235fb1bf153d3b19d2 state=OFFLINE, ts=1402818385674, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,680 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:25,680 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {8777fa63e8acbc235fb1bf153d3b19d2 state=OFFLINE, ts=1402818385674, server=null} to {8777fa63e8acbc235fb1bf153d3b19d2 state=PENDING_OPEN, ts=1402818385680, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:25,681 INFO [Priority.RpcServer.handler=3,port=47197] regionserver.RSRpcServices(1230): Open testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,685 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 8777fa63e8acbc235fb1bf153d3b19d2 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:25,686 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,687 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testDeleteColumnWithLatestTimeStampUsingMultipleVersions state from ENABLING to ENABLED 2014-06-15 07:46:25,686 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/8777fa63e8acbc235fb1bf153d3b19d2 2014-06-15 07:46:25,686 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 8777fa63e8acbc235fb1bf153d3b19d2 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:25,687 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(4462): Opening region: {ENCODED => 8777fa63e8acbc235fb1bf153d3b19d2, NAME => 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:25,688 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(5559): Registered coprocessor service: region=testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. service=VisibilityLabelsService 2014-06-15 07:46:25,688 INFO [RS_OPEN_REGION-asf008:47197-0] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:25,688 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testDeleteColumnWithLatestTimeStampUsingMultipleVersions 8777fa63e8acbc235fb1bf153d3b19d2 2014-06-15 07:46:25,688 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(646): Instantiated testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,689 DEBUG [AM.ZK.Worker-pool3-t10] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=8777fa63e8acbc235fb1bf153d3b19d2, current_state={8777fa63e8acbc235fb1bf153d3b19d2 state=PENDING_OPEN, ts=1402818385680, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:25,690 INFO [AM.ZK.Worker-pool3-t10] master.RegionStates(813): Transition {8777fa63e8acbc235fb1bf153d3b19d2 state=PENDING_OPEN, ts=1402818385680, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {8777fa63e8acbc235fb1bf153d3b19d2 state=OPENING, ts=1402818385690, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:25,691 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/write-master:458120000000000 2014-06-15 07:46:25,694 INFO [StoreOpener-8777fa63e8acbc235fb1bf153d3b19d2-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:25,694 INFO [StoreOpener-8777fa63e8acbc235fb1bf153d3b19d2-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:25,695 DEBUG [StoreOpener-8777fa63e8acbc235fb1bf153d3b19d2-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/info 2014-06-15 07:46:25,697 DEBUG [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2 2014-06-15 07:46:25,699 INFO [RS_OPEN_REGION-asf008:47197-0] regionserver.HRegion(747): Onlined 8777fa63e8acbc235fb1bf153d3b19d2; next sequenceid=2 2014-06-15 07:46:25,699 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 8777fa63e8acbc235fb1bf153d3b19d2 2014-06-15 07:46:25,700 INFO [PostOpenDeployTasks:8777fa63e8acbc235fb1bf153d3b19d2] regionserver.HRegionServer(1663): Post open deploy tasks for testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,704 INFO [PostOpenDeployTasks:8777fa63e8acbc235fb1bf153d3b19d2] catalog.MetaEditor(464): Updated row testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,704 DEBUG [PostOpenDeployTasks:8777fa63e8acbc235fb1bf153d3b19d2] regionserver.HRegionServer(1693): Finished post open deploy task for testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,704 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 8777fa63e8acbc235fb1bf153d3b19d2 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:25,719 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/8777fa63e8acbc235fb1bf153d3b19d2 2014-06-15 07:46:25,719 DEBUG [RS_OPEN_REGION-asf008:47197-0] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 8777fa63e8acbc235fb1bf153d3b19d2 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:25,720 DEBUG [RS_OPEN_REGION-asf008:47197-0] coordination.ZkOpenRegionCoordination(91): Transitioned 8777fa63e8acbc235fb1bf153d3b19d2 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,720 DEBUG [RS_OPEN_REGION-asf008:47197-0] handler.OpenRegionHandler(167): Opened testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,720 DEBUG [AM.ZK.Worker-pool3-t12] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=8777fa63e8acbc235fb1bf153d3b19d2, current_state={8777fa63e8acbc235fb1bf153d3b19d2 state=OPENING, ts=1402818385690, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:25,720 INFO [AM.ZK.Worker-pool3-t12] master.RegionStates(813): Transition {8777fa63e8acbc235fb1bf153d3b19d2 state=OPENING, ts=1402818385690, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {8777fa63e8acbc235fb1bf153d3b19d2 state=OPEN, ts=1402818385720, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:25,720 DEBUG [AM.ZK.Worker-pool3-t12] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 8777fa63e8acbc235fb1bf153d3b19d2 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:25,724 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/8777fa63e8acbc235fb1bf153d3b19d2 2014-06-15 07:46:25,724 DEBUG [AM.ZK.Worker-pool3-t12] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 8777fa63e8acbc235fb1bf153d3b19d2 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:25,724 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:25,724 DEBUG [AM.ZK.Worker-pool3-t12] master.AssignmentManager$4(1293): Znode testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. deleted, state: {8777fa63e8acbc235fb1bf153d3b19d2 state=OPEN, ts=1402818385720, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:25,724 INFO [AM.ZK.Worker-pool3-t12] master.RegionStates(359): Onlined 8777fa63e8acbc235fb1bf153d3b19d2 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,725 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:25,725 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,729 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:25,730 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:25,731 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0095 connected 2014-06-15 07:46:25,733 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0095, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,763 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:25,763 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,766 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:25,766 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:25,767 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0096 connected 2014-06-15 07:46:25,780 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:25,780 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,783 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:25,783 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:25,784 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0097 connected 2014-06-15 07:46:25,787 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0097, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:25,790 INFO [RpcServer.handler=4,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:25,796 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' 2014-06-15 07:46:25,796 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:25,796 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' 2014-06-15 07:46:25,796 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:25,796 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,797 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,800 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,800 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,800 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,800 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,800 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,800 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,800 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,800 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,801 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,801 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,801 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,801 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,801 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,801 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,801 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:25,801 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:25,803 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:25,803 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,802 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:25,803 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:25,803 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,803 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:25,803 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,803 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:25,803 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:25,803 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:25,803 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,803 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:25,804 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:25,804 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:25,804 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:25,804 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool169-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,803 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:25,804 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool169-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. started... 2014-06-15 07:46:25,804 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:25,804 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:25,805 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool169-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2., current region memstore size 712 B 2014-06-15 07:46:25,805 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:25,806 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,807 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,807 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:25,809 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,810 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,810 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:25,827 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:25,828 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:25,832 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool169-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/.tmp/e9e2d2d4fa574d99a78e3e1ce9e8c10c 2014-06-15 07:46:25,840 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool169-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/.tmp/e9e2d2d4fa574d99a78e3e1ce9e8c10c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/info/e9e2d2d4fa574d99a78e3e1ce9e8c10c 2014-06-15 07:46:25,850 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool169-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/info/e9e2d2d4fa574d99a78e3e1ce9e8c10c, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:25,850 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool169-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. in 45ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:25,850 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool169-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:25,850 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:25,850 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:25,850 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,851 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:25,851 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:25,852 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,852 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,853 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,853 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,853 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:25,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,853 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,854 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,855 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,855 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' on coordinator 2014-06-15 07:46:25,855 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@171b6f5[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:25,855 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:25,855 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,857 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,858 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:25,857 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,858 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:25,858 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,857 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:25,858 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,858 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:25,857 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,857 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,858 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,858 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:25,859 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:25,859 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:25,859 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,860 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:25,860 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,860 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:25,860 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,860 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:25,860 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,860 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:25,861 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:25,861 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,861 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,861 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:25,862 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,862 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,862 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,863 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,863 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,863 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,863 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,863 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,864 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:25,864 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,864 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,864 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,864 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,864 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:25,864 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:25,865 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:25,865 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,865 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,865 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,866 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,866 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:25,866 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:25,867 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,867 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:25,867 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:25,867 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:25,868 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:25,868 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' execution completed 2014-06-15 07:46:25,868 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:25,868 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:25,868 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:25,868 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:25,869 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithLatestTimeStampUsingMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:25,890 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,890 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,890 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,890 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,890 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:25,890 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:25,890 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:25,896 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:25,896 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' 2014-06-15 07:46:25,896 INFO [RpcServer.handler=4,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:25,896 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampUsingMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:25,897 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:26,001 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:26,002 DEBUG [RpcServer.handler=2,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:26,003 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0096, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,010 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:26,010 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,012 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:26,012 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:26,013 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0098 connected 2014-06-15 07:46:26,024 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:26,024 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,029 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:26,029 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:26,030 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0099 connected 2014-06-15 07:46:26,034 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0099, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,040 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:26,118 DEBUG [RpcServer.handler=3,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:26,119 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' 2014-06-15 07:46:26,119 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,119 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' 2014-06-15 07:46:26,119 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:26,120 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,120 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,124 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,124 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,124 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,124 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,124 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,124 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,125 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,125 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,125 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,125 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,126 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,126 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,126 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:26,126 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,126 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,127 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,127 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,127 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,127 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,127 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,127 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,127 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,127 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,128 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,128 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:26,128 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,128 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:26,129 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,129 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:26,129 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,129 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:26,129 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:26,129 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:26,129 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:26,129 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,129 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:26,130 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:26,129 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool171-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:26,130 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,130 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool171-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. started... 2014-06-15 07:46:26,130 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:26,130 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:26,130 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool171-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2., current region memstore size 144 B 2014-06-15 07:46:26,130 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:26,132 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,133 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,133 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,134 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,134 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,134 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,155 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,157 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741942_1118 size 4956 2014-06-15 07:46:26,160 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool171-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=16, memsize=144, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/.tmp/318234841fb244cca66bd6925e35d92b 2014-06-15 07:46:26,172 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool171-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/.tmp/318234841fb244cca66bd6925e35d92b as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/info/318234841fb244cca66bd6925e35d92b 2014-06-15 07:46:26,190 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool171-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/info/318234841fb244cca66bd6925e35d92b, entries=1, sequenceid=16, filesize=4.8 K 2014-06-15 07:46:26,191 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool171-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~144 B/144, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. in 61ms, sequenceid=16, compaction requested=false 2014-06-15 07:46:26,191 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool171-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:26,191 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:26,191 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:26,191 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,191 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:26,191 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:26,194 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,194 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,195 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,195 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,195 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,195 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,195 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,195 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,195 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,195 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,196 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,197 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,197 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,197 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,198 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,198 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,198 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' on coordinator 2014-06-15 07:46:26,198 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@11a6c8d[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:26,198 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:26,198 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,200 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,200 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,200 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,200 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,200 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,200 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,200 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,200 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,200 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,201 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,201 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:26,201 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:26,201 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:26,201 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,200 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,200 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:26,201 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:26,201 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:26,201 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,202 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:26,202 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:26,202 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:26,203 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:26,203 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,203 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:26,203 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,204 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:26,204 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,204 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:26,204 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,204 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:26,204 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:26,204 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,205 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,205 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,205 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,206 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,207 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,208 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,208 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,209 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:26,209 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,209 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,209 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,209 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,209 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,209 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,210 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,210 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,210 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,210 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,211 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,211 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,211 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,211 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,212 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:26,213 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' execution completed 2014-06-15 07:46:26,213 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:26,213 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:26,213 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,213 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:26,213 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithLatestTimeStampUsingMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:26,217 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,217 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,217 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,217 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,218 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,218 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,218 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,218 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,218 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,257 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,257 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' 2014-06-15 07:46:26,257 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:26,257 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampUsingMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:26,258 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:26,358 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:26,359 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:26,359 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a0098, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,373 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:26,373 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,374 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:26,375 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:26,376 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009a connected 2014-06-15 07:46:26,386 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:26,386 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,387 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:26,387 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:26,388 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009b connected 2014-06-15 07:46:26,390 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009b, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,392 INFO [RpcServer.handler=0,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:26,397 DEBUG [RpcServer.handler=0,port=45812] procedure.ProcedureCoordinator(158): Procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersions was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:26,397 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' 2014-06-15 07:46:26,397 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,397 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' 2014-06-15 07:46:26,397 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions', kicking off acquire phase on members. 2014-06-15 07:46:26,398 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,398 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,399 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,399 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,399 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,399 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,399 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,399 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,399 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,400 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,400 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,399 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,400 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,400 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:26,400 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,400 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,400 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,400 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,401 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersions is still present, removing 2014-06-15 07:46:26,402 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,402 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersions is still present, removing 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:26,402 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,402 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testDeleteColumnWithLatestTimeStampUsingMultipleVersions is still present, removing 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:26,402 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' with timeout 60000ms 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:26,403 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,402 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:26,402 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool175-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:26,403 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'acquire' stage 2014-06-15 07:46:26,403 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:26,403 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:26,403 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool175-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. started... 2014-06-15 07:46:26,403 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:26,403 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:26,404 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool175-thread-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2., current region memstore size 136 B 2014-06-15 07:46:26,405 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,406 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,406 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,406 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,406 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,406 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,421 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,422 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,424 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool175-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=19, memsize=136, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/.tmp/b450a627e3f14198a7e8b59d5965531c 2014-06-15 07:46:26,432 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool175-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/.tmp/b450a627e3f14198a7e8b59d5965531c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/info/b450a627e3f14198a7e8b59d5965531c 2014-06-15 07:46:26,441 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool175-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/8777fa63e8acbc235fb1bf153d3b19d2/info/b450a627e3f14198a7e8b59d5965531c, entries=1, sequenceid=19, filesize=4.8 K 2014-06-15 07:46:26,441 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool175-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~136 B/136, currentsize=0 B/0 for region testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. in 37ms, sequenceid=19, compaction requested=true 2014-06-15 07:46:26,441 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool175-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:26,441 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:26,441 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:26,441 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,441 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally acquired 2014-06-15 07:46:26,441 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testDeleteColumnWithLatestTimeStampUsingMultipleVersions) in zk 2014-06-15 07:46:26,443 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,443 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,443 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,443 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,443 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,443 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,443 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,443 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,443 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,444 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,444 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,444 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,445 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,445 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,445 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,445 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,446 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' on coordinator 2014-06-15 07:46:26,446 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@11c3b04[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:26,446 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' starting 'in-barrier' execution. 2014-06-15 07:46:26,446 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,447 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,447 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,447 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,447 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,447 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,447 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,447 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:26,448 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,448 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:26,448 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:26,448 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:26,448 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:26,448 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,448 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,447 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,447 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,448 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:26,448 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,448 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,449 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,449 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' received 'reached' from coordinator. 2014-06-15 07:46:26,449 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' locally completed 2014-06-15 07:46:26,449 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:26,450 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:26,450 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,450 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,450 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:26,452 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:26,452 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,452 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' has notified controller of completion 2014-06-15 07:46:26,452 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:26,452 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,452 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,452 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' completed. 2014-06-15 07:46:26,452 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,452 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,453 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,453 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,453 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,453 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,454 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,454 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,454 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:26,454 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,454 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,454 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,454 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testDeleteColumnWithLatestTimeStampUsingMultipleVersions/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,454 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,455 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,455 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,455 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,455 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,455 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,456 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,456 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,456 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,456 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,456 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,457 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,457 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,457 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:26,457 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testDeleteColumnWithLatestTimeStampUsingMultipleVersions', counting down latch. Waiting for 0 more 2014-06-15 07:46:26,457 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' execution completed 2014-06-15 07:46:26,458 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:26,458 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:26,458 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testDeleteColumnWithLatestTimeStampUsingMultipleVersions 2014-06-15 07:46:26,458 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testDeleteColumnWithLatestTimeStampUsingMultipleVersionsincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:26,462 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,462 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,462 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,462 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,462 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,463 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,463 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,462 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,463 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,466 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,466 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testDeleteColumnWithLatestTimeStampUsingMultipleVersions' 2014-06-15 07:46:26,466 INFO [RpcServer.handler=0,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:26,466 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testDeleteColumnWithLatestTimeStampUsingMultipleVersions'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:26,466 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:26,567 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:26,569 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:26,569 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009a, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,601 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testDeleteColumnWithLatestTimeStampUsingMultipleVersions Thread=381 (was 380) - Thread LEAK? -, OpenFileDescriptor=611 (was 601) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=573 (was 573), ProcessCount=176 (was 176), AvailableMemoryMB=2803 (was 2940), ConnectionCount=8 (was 8) 2014-06-15 07:46:26,622 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteFamily Thread=380, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=573, ProcessCount=176, AvailableMemoryMB=2803, ConnectionCount=8 2014-06-15 07:46:26,656 DEBUG [RpcServer.handler=1,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:26,658 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:26,660 INFO [RpcServer.handler=0,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testVisibilityLabelsWithDeleteFamily', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:26,670 DEBUG [RpcServer.handler=0,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testVisibilityLabelsWithDeleteFamily/write-master:458120000000000 2014-06-15 07:46:26,675 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,689 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,691 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,699 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testVisibilityLabelsWithDeleteFamily/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:26,700 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamily-1] regionserver.HRegion(4277): creating HRegion testVisibilityLabelsWithDeleteFamily HTD == 'testVisibilityLabelsWithDeleteFamily', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,718 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,719 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,723 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamily-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,723 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamily-1] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101.: disabling compactions & flushes 2014-06-15 07:46:26,723 DEBUG [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamily-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,723 INFO [RegionOpenAndInitThread-testVisibilityLabelsWithDeleteFamily-1] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,729 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:26,729 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,729 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node cd5b5e69fe7b3e3a1af5246737707101 with OFFLINE state 2014-06-15 07:46:26,731 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:26,731 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={cd5b5e69fe7b3e3a1af5246737707101 state=OFFLINE, ts=1402818386729, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,732 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={cd5b5e69fe7b3e3a1af5246737707101 state=OFFLINE, ts=1402818386729, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,735 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:26,735 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {cd5b5e69fe7b3e3a1af5246737707101 state=OFFLINE, ts=1402818386729, server=null} to {cd5b5e69fe7b3e3a1af5246737707101 state=PENDING_OPEN, ts=1402818386735, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:26,736 INFO [Priority.RpcServer.handler=4,port=47197] regionserver.RSRpcServices(1230): Open testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,740 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning cd5b5e69fe7b3e3a1af5246737707101 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:26,741 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,741 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testVisibilityLabelsWithDeleteFamily state from ENABLING to ENABLED 2014-06-15 07:46:26,742 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/cd5b5e69fe7b3e3a1af5246737707101 2014-06-15 07:46:26,742 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node cd5b5e69fe7b3e3a1af5246737707101 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:26,742 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(4462): Opening region: {ENCODED => cd5b5e69fe7b3e3a1af5246737707101, NAME => 'testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:26,743 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(5559): Registered coprocessor service: region=testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. service=VisibilityLabelsService 2014-06-15 07:46:26,743 INFO [RS_OPEN_REGION-asf008:47197-1] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:26,743 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testVisibilityLabelsWithDeleteFamily cd5b5e69fe7b3e3a1af5246737707101 2014-06-15 07:46:26,743 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(646): Instantiated testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,744 DEBUG [AM.ZK.Worker-pool3-t15] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=cd5b5e69fe7b3e3a1af5246737707101, current_state={cd5b5e69fe7b3e3a1af5246737707101 state=PENDING_OPEN, ts=1402818386735, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:26,744 INFO [AM.ZK.Worker-pool3-t15] master.RegionStates(813): Transition {cd5b5e69fe7b3e3a1af5246737707101 state=PENDING_OPEN, ts=1402818386735, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {cd5b5e69fe7b3e3a1af5246737707101 state=OPENING, ts=1402818386744, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:26,745 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testVisibilityLabelsWithDeleteFamily/write-master:458120000000000 2014-06-15 07:46:26,749 INFO [StoreOpener-cd5b5e69fe7b3e3a1af5246737707101-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:26,750 INFO [StoreOpener-cd5b5e69fe7b3e3a1af5246737707101-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:26,751 DEBUG [StoreOpener-cd5b5e69fe7b3e3a1af5246737707101-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamily/cd5b5e69fe7b3e3a1af5246737707101/info 2014-06-15 07:46:26,752 DEBUG [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamily/cd5b5e69fe7b3e3a1af5246737707101 2014-06-15 07:46:26,753 INFO [RS_OPEN_REGION-asf008:47197-1] regionserver.HRegion(747): Onlined cd5b5e69fe7b3e3a1af5246737707101; next sequenceid=2 2014-06-15 07:46:26,753 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node cd5b5e69fe7b3e3a1af5246737707101 2014-06-15 07:46:26,754 INFO [PostOpenDeployTasks:cd5b5e69fe7b3e3a1af5246737707101] regionserver.HRegionServer(1663): Post open deploy tasks for testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,760 INFO [PostOpenDeployTasks:cd5b5e69fe7b3e3a1af5246737707101] catalog.MetaEditor(464): Updated row testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,761 DEBUG [PostOpenDeployTasks:cd5b5e69fe7b3e3a1af5246737707101] regionserver.HRegionServer(1693): Finished post open deploy task for testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,761 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning cd5b5e69fe7b3e3a1af5246737707101 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:26,763 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/cd5b5e69fe7b3e3a1af5246737707101 2014-06-15 07:46:26,763 DEBUG [RS_OPEN_REGION-asf008:47197-1] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node cd5b5e69fe7b3e3a1af5246737707101 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:26,763 DEBUG [RS_OPEN_REGION-asf008:47197-1] coordination.ZkOpenRegionCoordination(91): Transitioned cd5b5e69fe7b3e3a1af5246737707101 to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,764 DEBUG [RS_OPEN_REGION-asf008:47197-1] handler.OpenRegionHandler(167): Opened testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,764 DEBUG [AM.ZK.Worker-pool3-t16] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=cd5b5e69fe7b3e3a1af5246737707101, current_state={cd5b5e69fe7b3e3a1af5246737707101 state=OPENING, ts=1402818386744, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:26,764 INFO [AM.ZK.Worker-pool3-t16] master.RegionStates(813): Transition {cd5b5e69fe7b3e3a1af5246737707101 state=OPENING, ts=1402818386744, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {cd5b5e69fe7b3e3a1af5246737707101 state=OPEN, ts=1402818386764, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:26,765 DEBUG [AM.ZK.Worker-pool3-t16] coordination.ZkOpenRegionCoordination(350): Handling OPENED of cd5b5e69fe7b3e3a1af5246737707101 from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:26,766 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/cd5b5e69fe7b3e3a1af5246737707101 2014-06-15 07:46:26,766 DEBUG [AM.ZK.Worker-pool3-t16] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node cd5b5e69fe7b3e3a1af5246737707101 in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:26,766 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:26,766 DEBUG [AM.ZK.Worker-pool3-t16] master.AssignmentManager$4(1293): Znode testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. deleted, state: {cd5b5e69fe7b3e3a1af5246737707101 state=OPEN, ts=1402818386764, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:26,766 INFO [AM.ZK.Worker-pool3-t16] master.RegionStates(359): Onlined cd5b5e69fe7b3e3a1af5246737707101 on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,783 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:26,783 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,785 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:26,786 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:26,787 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009c connected 2014-06-15 07:46:26,788 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009c, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,791 INFO [pool-1-thread-1] hbase.Waiter(174): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2014-06-15 07:46:26,813 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:26,813 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,814 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:26,815 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:26,816 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009d connected 2014-06-15 07:46:26,826 INFO [pool-1-thread-1] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:26,827 DEBUG [pool-1-thread-1] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,828 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:26,828 DEBUG [pool-1-thread-1] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:26,829 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009e connected 2014-06-15 07:46:26,831 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009e, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:26,833 INFO [RpcServer.handler=1,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:26,836 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testVisibilityLabelsWithDeleteFamily' 2014-06-15 07:46:26,837 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,837 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testVisibilityLabelsWithDeleteFamily' starting 'acquire' 2014-06-15 07:46:26,837 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testVisibilityLabelsWithDeleteFamily', kicking off acquire phase on members. 2014-06-15 07:46:26,837 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,837 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,838 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,838 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,839 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,839 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,839 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,839 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,838 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,839 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,839 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,839 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,839 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,839 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,839 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,840 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,840 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:26,840 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,841 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,841 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,841 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamily' with timeout 60000ms 2014-06-15 07:46:26,841 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,841 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,841 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,841 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:26,841 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,841 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamily' locally acquired 2014-06-15 07:46:26,841 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamily' with timeout 60000ms 2014-06-15 07:46:26,841 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testVisibilityLabelsWithDeleteFamily' with timeout 60000ms 2014-06-15 07:46:26,841 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,842 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:26,842 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:26,842 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testVisibilityLabelsWithDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:26,842 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamily' locally acquired 2014-06-15 07:46:26,842 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:26,842 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:26,841 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamily) in zk 2014-06-15 07:46:26,842 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamily) in zk 2014-06-15 07:46:26,842 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,842 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. started... 2014-06-15 07:46:26,843 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] regionserver.HRegion(1696): Started memstore flush for testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101., current region memstore size 416 B 2014-06-15 07:46:26,845 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,845 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,846 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,846 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,846 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,846 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,862 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,863 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:26,866 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=9, memsize=416, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamily/cd5b5e69fe7b3e3a1af5246737707101/.tmp/ca06d65806d447c0ae4cee763dc00950 2014-06-15 07:46:26,895 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca06d65806d447c0ae4cee763dc00950 2014-06-15 07:46:26,898 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamily/cd5b5e69fe7b3e3a1af5246737707101/.tmp/ca06d65806d447c0ae4cee763dc00950 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamily/cd5b5e69fe7b3e3a1af5246737707101/info/ca06d65806d447c0ae4cee763dc00950 2014-06-15 07:46:26,909 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca06d65806d447c0ae4cee763dc00950 2014-06-15 07:46:26,909 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testVisibilityLabelsWithDeleteFamily/cd5b5e69fe7b3e3a1af5246737707101/info/ca06d65806d447c0ae4cee763dc00950, entries=2, sequenceid=9, filesize=4.8 K 2014-06-15 07:46:26,909 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~416 B/416, currentsize=0 B/0 for region testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. in 66ms, sequenceid=9, compaction requested=false 2014-06-15 07:46:26,910 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool179-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:26,910 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:26,910 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:26,910 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,910 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testVisibilityLabelsWithDeleteFamily' locally acquired 2014-06-15 07:46:26,911 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testVisibilityLabelsWithDeleteFamily) in zk 2014-06-15 07:46:26,913 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,913 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,913 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,913 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,913 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,913 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,913 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,913 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,913 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testVisibilityLabelsWithDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:26,914 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,915 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,915 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,915 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,916 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,916 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,916 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,917 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testVisibilityLabelsWithDeleteFamily' on coordinator 2014-06-15 07:46:26,917 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@19ab59a[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:26,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testVisibilityLabelsWithDeleteFamily' starting 'in-barrier' execution. 2014-06-15 07:46:26,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,919 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,919 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,919 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,919 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,919 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:26,919 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,919 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamily' locally completed 2014-06-15 07:46:26,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,920 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:26,920 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:26,920 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamily' locally completed 2014-06-15 07:46:26,919 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,920 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:26,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,919 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,920 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testVisibilityLabelsWithDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:26,920 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testVisibilityLabelsWithDeleteFamily' locally completed 2014-06-15 07:46:26,920 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testVisibilityLabelsWithDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:26,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,923 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,923 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamily' has notified controller of completion 2014-06-15 07:46:26,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamily' completed. 2014-06-15 07:46:26,924 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamily' has notified controller of completion 2014-06-15 07:46:26,924 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,924 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamily' completed. 2014-06-15 07:46:26,925 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,925 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testVisibilityLabelsWithDeleteFamily' has notified controller of completion 2014-06-15 07:46:26,925 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,925 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testVisibilityLabelsWithDeleteFamily' completed. 2014-06-15 07:46:26,926 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,926 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,926 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,928 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,928 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,928 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,930 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,930 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,930 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,931 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testVisibilityLabelsWithDeleteFamily' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:26,931 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,931 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,931 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,931 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testVisibilityLabelsWithDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,931 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:26,931 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:26,932 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:26,932 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,932 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,933 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,933 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,933 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:26,934 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:26,934 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,934 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:26,934 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:26,935 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:26,935 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testVisibilityLabelsWithDeleteFamily' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:26,935 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testVisibilityLabelsWithDeleteFamily', counting down latch. Waiting for 0 more 2014-06-15 07:46:26,935 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testVisibilityLabelsWithDeleteFamily' execution completed 2014-06-15 07:46:26,935 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:26,935 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:26,935 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testVisibilityLabelsWithDeleteFamily 2014-06-15 07:46:26,936 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testVisibilityLabelsWithDeleteFamilyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:26,967 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,968 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,968 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,968 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,968 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,967 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:26,968 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,968 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:26,969 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:26,977 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:26,977 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testVisibilityLabelsWithDeleteFamily' 2014-06-15 07:46:26,977 INFO [RpcServer.handler=1,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:26,978 DEBUG [pool-1-thread-1] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testVisibilityLabelsWithDeleteFamily'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:26,978 DEBUG [pool-1-thread-1] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:27,078 DEBUG [pool-1-thread-1] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:27,080 DEBUG [RpcServer.handler=0,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:27,080 DEBUG [pool-1-thread-1] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,118 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testVisibilityLabelsWithDeleteFamily Thread=380 (was 380), OpenFileDescriptor=617 (was 613) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=573 (was 573), ProcessCount=176 (was 176), AvailableMemoryMB=2737 (was 2803), ConnectionCount=8 (was 8) 2014-06-15 07:46:27,140 INFO [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDeletes#testSpecificDeletesFollowedByDeleteFamily Thread=381, OpenFileDescriptor=619, MaxFileDescriptor=60000, SystemLoadAverage=573, ProcessCount=176, AvailableMemoryMB=2735, ConnectionCount=8 2014-06-15 07:46:27,179 DEBUG [RpcServer.handler=2,port=47197] zookeeper.RecoverableZooKeeper(508): Node /hbase/visibility/user_auths already exists 2014-06-15 07:46:27,182 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/visibility/user_auths 2014-06-15 07:46:27,185 INFO [RpcServer.handler=4,port=45812] master.HMaster(1124): Client=jenkins//67.195.138.23 create 'testSpecificDeletesFollowedByDeleteFamily', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} 2014-06-15 07:46:27,190 DEBUG [RpcServer.handler=4,port=45812] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/testSpecificDeletesFollowedByDeleteFamily/write-master:458120000000000 2014-06-15 07:46:27,196 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] handler.CreateTableHandler(175): Create table testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,214 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:27,216 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741947_1123 size 321 2014-06-15 07:46:27,223 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] util.FSTableDescriptors(640): Wrote descriptor into: hdfs://localhost:37161/user/jenkins/hbase/.tmp/data/default/testSpecificDeletesFollowedByDeleteFamily/.tabledesc/.tableinfo.0000000001 2014-06-15 07:46:27,225 INFO [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily-1] regionserver.HRegion(4277): creating HRegion testSpecificDeletesFollowedByDeleteFamily HTD == 'testSpecificDeletesFollowedByDeleteFamily', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', VERSIONS => '5', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:37161/user/jenkins/hbase/.tmp Table name == testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,256 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:27,258 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:27,280 DEBUG [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily-1] regionserver.HRegion(646): Instantiated testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,280 DEBUG [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily-1] regionserver.HRegion(1116): Closing testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab.: disabling compactions & flushes 2014-06-15 07:46:27,280 DEBUG [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily-1] regionserver.HRegion(1143): Updates disabled for region testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,280 INFO [RegionOpenAndInitThread-testSpecificDeletesFollowedByDeleteFamily-1] regionserver.HRegion(1225): Closed testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,321 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] catalog.MetaEditor(278): Added 1 2014-06-15 07:46:27,321 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1549): Assigning 1 region(s) to asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,321 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKAssign(175): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Async create of unassigned node 4864a8248c1780569e80f2a8962d3fab with OFFLINE state 2014-06-15 07:46:27,323 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:27,323 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback(69): rs={4864a8248c1780569e80f2a8962d3fab state=OFFLINE, ts=1402818387321, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,323 DEBUG [pool-1-thread-1-EventThread] master.OfflineCallback$ExistCallback(106): rs={4864a8248c1780569e80f2a8962d3fab state=OFFLINE, ts=1402818387321, server=null}, server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,327 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1602): asf008.sp2.ygridcore.net,47197,1402818342492 unassigned znodes=1 of total=1; oldCounter=0 2014-06-15 07:46:27,327 INFO [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.RegionStates(813): Transition {4864a8248c1780569e80f2a8962d3fab state=OFFLINE, ts=1402818387321, server=null} to {4864a8248c1780569e80f2a8962d3fab state=PENDING_OPEN, ts=1402818387327, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:27,328 INFO [Priority.RpcServer.handler=5,port=47197] regionserver.RSRpcServices(1230): Open testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,334 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 4864a8248c1780569e80f2a8962d3fab from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:27,334 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] master.AssignmentManager(1728): Bulk assigning done for asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,334 WARN [MASTER_TABLE_OPERATIONS-asf008:45812-0] zookeeper.ZKTableStateManager(100): Moving table testSpecificDeletesFollowedByDeleteFamily state from ENABLING to ENABLED 2014-06-15 07:46:27,336 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/4864a8248c1780569e80f2a8962d3fab 2014-06-15 07:46:27,336 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 4864a8248c1780569e80f2a8962d3fab from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING 2014-06-15 07:46:27,337 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(4462): Opening region: {ENCODED => 4864a8248c1780569e80f2a8962d3fab, NAME => 'testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab.', STARTKEY => '', ENDKEY => ''} 2014-06-15 07:46:27,337 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(5559): Registered coprocessor service: region=testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. service=VisibilityLabelsService 2014-06-15 07:46:27,337 INFO [RS_OPEN_REGION-asf008:47197-2] coprocessor.CoprocessorHost(145): System coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController was loaded successfully with priority (536870911). 2014-06-15 07:46:27,338 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.MetricsRegionSourceImpl(64): Creating new MetricsRegionSourceImpl for table testSpecificDeletesFollowedByDeleteFamily 4864a8248c1780569e80f2a8962d3fab 2014-06-15 07:46:27,338 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(646): Instantiated testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,338 DEBUG [AM.ZK.Worker-pool3-t20] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENING, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=4864a8248c1780569e80f2a8962d3fab, current_state={4864a8248c1780569e80f2a8962d3fab state=PENDING_OPEN, ts=1402818387327, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:27,338 INFO [AM.ZK.Worker-pool3-t20] master.RegionStates(813): Transition {4864a8248c1780569e80f2a8962d3fab state=PENDING_OPEN, ts=1402818387327, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {4864a8248c1780569e80f2a8962d3fab state=OPENING, ts=1402818387338, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:27,340 DEBUG [MASTER_TABLE_OPERATIONS-asf008:45812-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/testSpecificDeletesFollowedByDeleteFamily/write-master:458120000000000 2014-06-15 07:46:27,346 INFO [StoreOpener-4864a8248c1780569e80f2a8962d3fab-1] hfile.CacheConfig(281): blockCache=org.apache.hadoop.hbase.io.hfile.LruBlockCache@129dcc0, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheCompressed=false, prefetchOnOpen=false 2014-06-15 07:46:27,346 INFO [StoreOpener-4864a8248c1780569e80f2a8962d3fab-1] compactions.CompactionConfiguration(91): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000 2014-06-15 07:46:27,348 DEBUG [StoreOpener-4864a8248c1780569e80f2a8962d3fab-1] regionserver.HRegionFileSystem(194): No StoreFiles for: hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/info 2014-06-15 07:46:27,349 DEBUG [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(3101): Found 0 recovered edits file(s) under hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab 2014-06-15 07:46:27,351 INFO [RS_OPEN_REGION-asf008:47197-2] regionserver.HRegion(747): Onlined 4864a8248c1780569e80f2a8962d3fab; next sequenceid=2 2014-06-15 07:46:27,351 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(643): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Attempting to retransition opening state of node 4864a8248c1780569e80f2a8962d3fab 2014-06-15 07:46:27,353 INFO [PostOpenDeployTasks:4864a8248c1780569e80f2a8962d3fab] regionserver.HRegionServer(1663): Post open deploy tasks for testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,357 INFO [PostOpenDeployTasks:4864a8248c1780569e80f2a8962d3fab] catalog.MetaEditor(464): Updated row testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. with server=asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,357 DEBUG [PostOpenDeployTasks:4864a8248c1780569e80f2a8962d3fab] regionserver.HRegionServer(1693): Finished post open deploy task for testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,358 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(805): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioning 4864a8248c1780569e80f2a8962d3fab from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:27,361 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/region-in-transition/4864a8248c1780569e80f2a8962d3fab 2014-06-15 07:46:27,361 DEBUG [RS_OPEN_REGION-asf008:47197-2] zookeeper.ZKAssign(880): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Transitioned node 4864a8248c1780569e80f2a8962d3fab from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED 2014-06-15 07:46:27,361 DEBUG [RS_OPEN_REGION-asf008:47197-2] coordination.ZkOpenRegionCoordination(91): Transitioned 4864a8248c1780569e80f2a8962d3fab to OPENED in zk on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,361 DEBUG [RS_OPEN_REGION-asf008:47197-2] handler.OpenRegionHandler(167): Opened testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,361 DEBUG [AM.ZK.Worker-pool3-t3] master.AssignmentManager(908): Handling RS_ZK_REGION_OPENED, server=asf008.sp2.ygridcore.net,47197,1402818342492, region=4864a8248c1780569e80f2a8962d3fab, current_state={4864a8248c1780569e80f2a8962d3fab state=OPENING, ts=1402818387338, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:27,361 INFO [AM.ZK.Worker-pool3-t3] master.RegionStates(813): Transition {4864a8248c1780569e80f2a8962d3fab state=OPENING, ts=1402818387338, server=asf008.sp2.ygridcore.net,47197,1402818342492} to {4864a8248c1780569e80f2a8962d3fab state=OPEN, ts=1402818387361, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:27,362 DEBUG [AM.ZK.Worker-pool3-t3] coordination.ZkOpenRegionCoordination(350): Handling OPENED of 4864a8248c1780569e80f2a8962d3fab from asf008.sp2.ygridcore.net,45812,1402818342029; deleting unassigned node 2014-06-15 07:46:27,368 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition/4864a8248c1780569e80f2a8962d3fab 2014-06-15 07:46:27,368 DEBUG [AM.ZK.Worker-pool3-t3] zookeeper.ZKAssign(480): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Deleted unassigned node 4864a8248c1780569e80f2a8962d3fab in expected state RS_ZK_REGION_OPENED 2014-06-15 07:46:27,368 DEBUG [AM.ZK.Worker-pool3-t3] master.AssignmentManager$4(1293): Znode testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. deleted, state: {4864a8248c1780569e80f2a8962d3fab state=OPEN, ts=1402818387361, server=asf008.sp2.ygridcore.net,47197,1402818342492} 2014-06-15 07:46:27,368 INFO [AM.ZK.Worker-pool3-t3] master.RegionStates(359): Onlined 4864a8248c1780569e80f2a8962d3fab on asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,368 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition 2014-06-15 07:46:27,526 INFO [Thread-1239] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:27,526 DEBUG [Thread-1239] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,527 DEBUG [Thread-1239] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:27,527 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:27,528 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009f connected 2014-06-15 07:46:27,530 DEBUG [Thread-1239] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a009f, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,568 INFO [Thread-1239] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:27,568 DEBUG [Thread-1239] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,569 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:27,569 DEBUG [Thread-1239] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:27,570 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a0 connected 2014-06-15 07:46:27,581 INFO [Thread-1239] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:27,582 DEBUG [Thread-1239] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,585 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:27,585 DEBUG [Thread-1239] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:27,586 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a1 connected 2014-06-15 07:46:27,589 DEBUG [Thread-1239] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a1, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,592 INFO [RpcServer.handler=2,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:27,598 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testSpecificDeletesFollowedByDeleteFamily' 2014-06-15 07:46:27,598 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:27,598 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'acquire' 2014-06-15 07:46:27,598 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testSpecificDeletesFollowedByDeleteFamily', kicking off acquire phase on members. 2014-06-15 07:46:27,599 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,599 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,600 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,600 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,600 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,600 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,601 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,601 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,601 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,601 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:27,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,600 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,601 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,601 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,603 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,602 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily' with timeout 60000ms 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily' with timeout 60000ms 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:27,603 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:27,603 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily' with timeout 60000ms 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally acquired 2014-06-15 07:46:27,603 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:27,604 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily) in zk 2014-06-15 07:46:27,604 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool181-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,604 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:27,605 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally acquired 2014-06-15 07:46:27,604 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:27,605 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool181-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. started... 2014-06-15 07:46:27,605 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily) in zk 2014-06-15 07:46:27,605 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,606 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,606 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:27,607 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool181-thread-1] regionserver.HRegion(1696): Started memstore flush for testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab., current region memstore size 712 B 2014-06-15 07:46:27,608 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,608 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,608 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:27,636 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:27,638 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:27,640 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool181-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=13, memsize=712, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/.tmp/b84aee58d8364db2994a9f2fbf4d83b2 2014-06-15 07:46:27,651 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool181-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/.tmp/b84aee58d8364db2994a9f2fbf4d83b2 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/info/b84aee58d8364db2994a9f2fbf4d83b2 2014-06-15 07:46:27,661 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool181-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/info/b84aee58d8364db2994a9f2fbf4d83b2, entries=5, sequenceid=13, filesize=5.0 K 2014-06-15 07:46:27,661 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool181-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~712 B/712, currentsize=0 B/0 for region testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. in 54ms, sequenceid=13, compaction requested=false 2014-06-15 07:46:27,661 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool181-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,661 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:27,662 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:27,662 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,662 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally acquired 2014-06-15 07:46:27,662 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily) in zk 2014-06-15 07:46:27,664 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,664 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,664 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,664 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,664 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,665 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:27,665 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:27,665 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,665 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:27,665 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:27,665 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,666 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:27,666 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,673 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:27,674 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:27,674 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:27,675 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testSpecificDeletesFollowedByDeleteFamily' on coordinator 2014-06-15 07:46:27,675 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@4324d9[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:27,675 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'in-barrier' execution. 2014-06-15 07:46:27,676 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,688 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,689 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,689 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,689 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,689 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,689 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,689 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:27,689 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:27,690 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally completed 2014-06-15 07:46:27,688 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,690 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:27,690 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,690 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:27,690 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally completed 2014-06-15 07:46:27,690 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:27,689 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally completed 2014-06-15 07:46:27,690 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:27,689 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,691 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:27,691 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:27,692 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' has notified controller of completion 2014-06-15 07:46:27,692 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:27,692 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' completed. 2014-06-15 07:46:27,692 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' has notified controller of completion 2014-06-15 07:46:27,693 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:27,693 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:27,693 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' completed. 2014-06-15 07:46:27,693 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' has notified controller of completion 2014-06-15 07:46:27,693 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,693 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:27,694 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' completed. 2014-06-15 07:46:27,694 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:27,694 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,694 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:27,694 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:27,695 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:27,695 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,695 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:27,695 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:27,695 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,696 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testSpecificDeletesFollowedByDeleteFamily' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:27,696 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,696 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:27,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:27,696 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:27,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:27,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:27,697 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:27,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:27,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:27,698 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:27,699 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,699 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testSpecificDeletesFollowedByDeleteFamily' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:27,699 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testSpecificDeletesFollowedByDeleteFamily', counting down latch. Waiting for 0 more 2014-06-15 07:46:27,699 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testSpecificDeletesFollowedByDeleteFamily' execution completed 2014-06-15 07:46:27,699 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:27,699 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:27,699 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,699 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testSpecificDeletesFollowedByDeleteFamilyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:27,707 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,707 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,707 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,707 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,708 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,708 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,707 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,708 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,708 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,714 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:27,714 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testSpecificDeletesFollowedByDeleteFamily' 2014-06-15 07:46:27,715 INFO [RpcServer.handler=2,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:27,715 DEBUG [Thread-1239] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testSpecificDeletesFollowedByDeleteFamily'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:27,716 DEBUG [Thread-1239] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:27,816 DEBUG [Thread-1239] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:27,817 DEBUG [RpcServer.handler=1,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:27,818 DEBUG [Thread-1239] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a0, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,846 INFO [Thread-1239] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:27,846 DEBUG [Thread-1239] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,854 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:27,855 DEBUG [Thread-1239] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:27,856 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a2 connected 2014-06-15 07:46:27,872 INFO [Thread-1239] zookeeper.RecoverableZooKeeper(120): Process identifier=catalogtracker-on-hconnection-0x19cad9d connecting to ZooKeeper ensemble=localhost:53967 2014-06-15 07:46:27,872 DEBUG [Thread-1239] catalog.CatalogTracker(191): Starting catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,897 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(311): catalogtracker-on-hconnection-0x19cad9d, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-06-15 07:46:27,899 DEBUG [Thread-1239-EventThread] zookeeper.ZooKeeperWatcher(395): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a3 connected 2014-06-15 07:46:27,901 DEBUG [Thread-1239] zookeeper.ZKUtil(429): catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a3, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2014-06-15 07:46:27,906 DEBUG [Thread-1239] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a3, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:27,908 INFO [RpcServer.handler=3,port=45812] master.MasterRpcServices(638): Client=jenkins//67.195.138.23 procedure request for: flush-table-proc 2014-06-15 07:46:27,916 DEBUG [RpcServer.handler=3,port=45812] procedure.ProcedureCoordinator(158): Procedure testSpecificDeletesFollowedByDeleteFamily was in running list but was completed. Accepting new attempt. 2014-06-15 07:46:27,916 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(196): Starting procedure 'testSpecificDeletesFollowedByDeleteFamily' 2014-06-15 07:46:27,916 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:27,916 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(204): Procedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'acquire' 2014-06-15 07:46:27,916 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(246): Starting procedure 'testSpecificDeletesFollowedByDeleteFamily', kicking off acquire phase on members. 2014-06-15 07:46:27,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,917 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(94): Creating acquire znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,918 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(102): Watching for acquire node:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,918 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,918 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,918 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,918 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,918 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:27,919 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:27,919 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(208): Waiting for all members to 'acquire' 2014-06-15 07:46:27,918 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,919 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:27,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:27,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,919 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,919 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(184): Found procedure znode: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,920 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:27,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:27,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,920 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,920 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,921 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,920 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,921 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testSpecificDeletesFollowedByDeleteFamily is still present, removing 2014-06-15 07:46:27,921 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,921 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testSpecificDeletesFollowedByDeleteFamily is still present, removing 2014-06-15 07:46:27,921 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily' with timeout 60000ms 2014-06-15 07:46:27,921 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(203): start proc data length is 4 2014-06-15 07:46:27,922 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:27,922 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(212): Found data for znode:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,922 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:27,922 DEBUG [pool-1-thread-1-EventThread] flush.RegionServerFlushTableProcedureManager(150): Launching subprocedure to flush regions for testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,922 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally acquired 2014-06-15 07:46:27,921 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,922 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,57332,1402818342381' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily) in zk 2014-06-15 07:46:27,922 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily' with timeout 60000ms 2014-06-15 07:46:27,922 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:27,922 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:27,923 WARN [pool-1-thread-1-EventThread] procedure.ProcedureMember(151): A completed old subproc testSpecificDeletesFollowedByDeleteFamily is still present, removing 2014-06-15 07:46:27,923 DEBUG [pool-1-thread-1-EventThread] procedure.ProcedureMember(155): Submitting new Subprocedure:testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,923 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(152): Starting subprocedure 'testSpecificDeletesFollowedByDeleteFamily' with timeout 60000ms 2014-06-15 07:46:27,923 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(65): Starting region operation on testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:27,923 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.FlushTableSubprocedure(100): Flush region tasks submitted for 1 regions 2014-06-15 07:46:27,923 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(68): Flush region testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. started... 2014-06-15 07:46:27,923 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(238): Waiting for local region flush to finish. 2014-06-15 07:46:27,923 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(108): Scheduling process timer to run in: 60000 ms 2014-06-15 07:46:27,923 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(160): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'acquire' stage 2014-06-15 07:46:27,923 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,923 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally acquired 2014-06-15 07:46:27,924 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] regionserver.HRegion(1696): Started memstore flush for testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab., current region memstore size 416 B 2014-06-15 07:46:27,924 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,45812,1402818342029' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily) in zk 2014-06-15 07:46:27,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,924 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:27,926 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,958 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:27,959 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:27,975 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:27,976 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:27,979 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=20, memsize=416, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/.tmp/6fa6b6e013004b32bca849fe44c51d23 2014-06-15 07:46:27,991 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fa6b6e013004b32bca849fe44c51d23 2014-06-15 07:46:27,999 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/.tmp/6fa6b6e013004b32bca849fe44c51d23 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/info/6fa6b6e013004b32bca849fe44c51d23 2014-06-15 07:46:28,014 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fa6b6e013004b32bca849fe44c51d23 2014-06-15 07:46:28,014 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/info/6fa6b6e013004b32bca849fe44c51d23, entries=3, sequenceid=20, filesize=5.1 K 2014-06-15 07:46:28,014 INFO [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] regionserver.HRegion(1847): Finished memstore flush of ~416 B/416, currentsize=0 B/0 for region testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. in 91ms, sequenceid=20, compaction requested=false 2014-06-15 07:46:28,014 DEBUG [rs(asf008.sp2.ygridcore.net,47197,1402818342492)-flush-proc-pool184-thread-1] flush.FlushTableSubprocedure$RegionFlushTask(71): Closing region operation on testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:28,015 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(249): Completed 1/1 local region flush tasks. 2014-06-15 07:46:28,015 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(251): Completed 1 local region flush tasks. 2014-06-15 07:46:28,015 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(279): cancelling 0 flush region tasks asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,015 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(162): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally acquired 2014-06-15 07:46:28,015 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(241): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure (testSpecificDeletesFollowedByDeleteFamily) in zk 2014-06-15 07:46:28,017 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,017 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/acquired/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:28,017 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(249): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,017 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:28,018 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:28,018 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,018 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(167): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2014-06-15 07:46:28,018 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,018 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,019 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,019 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,020 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:28,021 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:28,021 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(297): member: 'asf008.sp2.ygridcore.net,47197,1402818342492' joining acquired barrier for procedure 'testSpecificDeletesFollowedByDeleteFamily' on coordinator 2014-06-15 07:46:28,021 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(306): Waiting on: java.util.concurrent.CountDownLatch@1279472[Count = 0] remaining members to acquire global barrier 2014-06-15 07:46:28,021 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(212): Procedure 'testSpecificDeletesFollowedByDeleteFamily' starting 'in-barrier' execution. 2014-06-15 07:46:28,022 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,023 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,023 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,024 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,024 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,024 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,024 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,024 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:28,024 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally completed 2014-06-15 07:46:28,024 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,45812,1402818342029' in zk 2014-06-15 07:46:28,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(130): Recieved reached global barrier:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,025 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:28,025 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,024 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(181): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' received 'reached' from coordinator. 2014-06-15 07:46:28,025 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally completed 2014-06-15 07:46:28,025 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,47197,1402818342492' in zk 2014-06-15 07:46:28,024 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:28,025 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:28,025 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(183): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' locally completed 2014-06-15 07:46:28,026 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.ZKProcedureMemberRpcs(265): Marking procedure 'testSpecificDeletesFollowedByDeleteFamily' completed for member 'asf008.sp2.ygridcore.net,57332,1402818342381' in zk 2014-06-15 07:46:28,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' has notified controller of completion 2014-06-15 07:46:28,027 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:28,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:28,027 DEBUG [member: 'asf008.sp2.ygridcore.net,45812,1402818342029' subprocedure-pool7-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' completed. 2014-06-15 07:46:28,028 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' has notified controller of completion 2014-06-15 07:46:28,028 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(188): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' has notified controller of completion 2014-06-15 07:46:28,029 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:28,029 DEBUG [member: 'asf008.sp2.ygridcore.net,47197,1402818342492' subprocedure-pool6-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' completed. 2014-06-15 07:46:28,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,029 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:28,029 DEBUG [member: 'asf008.sp2.ygridcore.net,57332,1402818342381' subprocedure-pool8-thread-1] procedure.Subprocedure(213): Subprocedure 'testSpecificDeletesFollowedByDeleteFamily' completed. 2014-06-15 07:46:28,029 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,030 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,030 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,030 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:28,031 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:28,031 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,031 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,032 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,032 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,032 WARN [pool-1-thread-1-EventThread] procedure.ProcedureCoordinator(292): Member 'testSpecificDeletesFollowedByDeleteFamily' is trying to release an unknown procedure 'reached' 2014-06-15 07:46:28,032 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,032 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(79): Received created event:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,032 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(99): Ignoring created notification for node:/hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,032 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(187): Node created: /hbase/flush-table-proc/reached/testSpecificDeletesFollowedByDeleteFamily/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(229): Current zk system: 2014-06-15 07:46:28,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(231): |-/hbase/flush-table-proc 2014-06-15 07:46:28,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-acquired 2014-06-15 07:46:28,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,033 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,034 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-abort 2014-06-15 07:46:28,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-reached 2014-06-15 07:46:28,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |----testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,035 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,036 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureUtil(248): |-------asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,037 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(212): Finished data from procedure 'testSpecificDeletesFollowedByDeleteFamily' member 'asf008.sp2.ygridcore.net,47197,1402818342492': 2014-06-15 07:46:28,037 DEBUG [pool-1-thread-1-EventThread] procedure.Procedure(328): Member: 'asf008.sp2.ygridcore.net,47197,1402818342492' released barrier for procedure'testSpecificDeletesFollowedByDeleteFamily', counting down latch. Waiting for 0 more 2014-06-15 07:46:28,037 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(220): Procedure 'testSpecificDeletesFollowedByDeleteFamily' execution completed 2014-06-15 07:46:28,039 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(229): Running finish phase. 2014-06-15 07:46:28,039 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.Procedure(280): Finished coordinator procedure - removing self from list of running procedures 2014-06-15 07:46:28,039 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureCoordinatorRpcs(158): Attempting to clean out zk node for op:testSpecificDeletesFollowedByDeleteFamily 2014-06-15 07:46:28,039 INFO [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] procedure.ZKProcedureUtil(269): Clearing all znodes for procedure testSpecificDeletesFollowedByDeleteFamilyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-06-15 07:46:28,062 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:28,063 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:28,063 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:28,063 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:28,063 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:28,063 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:28,062 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2014-06-15 07:46:28,063 INFO [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs$1(106): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2014-06-15 07:46:28,063 DEBUG [pool-1-thread-1-EventThread] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-06-15 07:46:28,069 DEBUG [(asf008.sp2.ygridcore.net,45812,1402818342029)-proc-coordinator-pool5-thread-1] errorhandling.TimeoutExceptionInjector(89): Marking timer as complete - no error notifications will be received for this timer. 2014-06-15 07:46:28,069 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(165): Done waiting - exec procedure flush-table-proc for 'testSpecificDeletesFollowedByDeleteFamily' 2014-06-15 07:46:28,069 INFO [RpcServer.handler=3,port=45812] flush.MasterFlushTableProcedureManager(167): Master flush table procedure is successful! 2014-06-15 07:46:28,070 DEBUG [Thread-1239] client.HBaseAdmin(3126): Waiting a max of 60000 ms for procedure 'flush-table-proc : testSpecificDeletesFollowedByDeleteFamily'' to complete. (max 1714 ms per retry) 2014-06-15 07:46:28,070 DEBUG [Thread-1239] client.HBaseAdmin(3135): (#1) Sleeping: 100ms while waiting for procedure completion. 2014-06-15 07:46:28,171 DEBUG [Thread-1239] client.HBaseAdmin(3141): Getting current status of procedure from master... 2014-06-15 07:46:28,172 DEBUG [RpcServer.handler=4,port=45812] master.MasterRpcServices(904): Checking to see if procedure from request:flush-table-proc is done 2014-06-15 07:46:28,172 DEBUG [Thread-1239] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=hconnection-0x19cad9d, zookeeper=catalogtracker-on-hconnection-0x19cad9d-0x1469e7d286a00a2, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:28,210 INFO [pool-1-thread-1] hbase.ResourceChecker(171): after: security.visibility.TestVisibilityLabelsWithDeletes#testSpecificDeletesFollowedByDeleteFamily Thread=379 (was 381), OpenFileDescriptor=614 (was 619), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=573 (was 573), ProcessCount=176 (was 176), AvailableMemoryMB=2628 (was 2735), ConnectionCount=8 (was 8) 2014-06-15 07:46:28,210 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(949): Shutting down minicluster 2014-06-15 07:46:28,211 DEBUG [pool-1-thread-1] util.JVMClusterUtil(243): Shutting down HBase Cluster 2014-06-15 07:46:28,211 DEBUG [pool-1-thread-1] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,212 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2014-06-15 07:46:28,212 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2014-06-15 07:46:28,212 INFO [pool-1-thread-1] regionserver.HRegionServer(1644): STOPPED: Cluster shutdown requested 2014-06-15 07:46:28,212 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2014-06-15 07:46:28,213 INFO [M:0;asf008:45812] regionserver.SplitLogWorker(588): Sending interrupt to stop the worker thread 2014-06-15 07:46:28,213 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-06-15 07:46:28,213 INFO [pool-1-thread-1] regionserver.HRegionServer(1644): STOPPED: Shutdown requested 2014-06-15 07:46:28,213 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-06-15 07:46:28,213 INFO [pool-1-thread-1] regionserver.HRegionServer(1644): STOPPED: Shutdown requested 2014-06-15 07:46:28,213 INFO [RS:0;asf008:57332] regionserver.SplitLogWorker(588): Sending interrupt to stop the worker thread 2014-06-15 07:46:28,213 INFO [RS:1;asf008:47197] regionserver.SplitLogWorker(588): Sending interrupt to stop the worker thread 2014-06-15 07:46:28,213 INFO [RS:0;asf008:57332] regionserver.HRegionServer(809): Stopping infoServer 2014-06-15 07:46:28,214 INFO [RS:1;asf008:47197] regionserver.HRegionServer(809): Stopping infoServer 2014-06-15 07:46:28,213 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,45812,1402818342029] regionserver.SplitLogWorker(203): SplitLogWorker interrupted. Exiting. 2014-06-15 07:46:28,213 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-06-15 07:46:28,215 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,45812,1402818342029] regionserver.SplitLogWorker(211): SplitLogWorker asf008.sp2.ygridcore.net,45812,1402818342029 exiting 2014-06-15 07:46:28,213 INFO [M:0;asf008:45812] regionserver.HRegionServer(809): Stopping infoServer 2014-06-15 07:46:28,214 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,47197,1402818342492] regionserver.SplitLogWorker(203): SplitLogWorker interrupted. Exiting. 2014-06-15 07:46:28,216 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,47197,1402818342492] regionserver.SplitLogWorker(211): SplitLogWorker asf008.sp2.ygridcore.net,47197,1402818342492 exiting 2014-06-15 07:46:28,213 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,57332,1402818342381] regionserver.SplitLogWorker(203): SplitLogWorker interrupted. Exiting. 2014-06-15 07:46:28,216 INFO [SplitLogWorker-asf008.sp2.ygridcore.net,57332,1402818342381] regionserver.SplitLogWorker(211): SplitLogWorker asf008.sp2.ygridcore.net,57332,1402818342381 exiting 2014-06-15 07:46:28,222 INFO [RS:1;asf008:47197] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-06-15 07:46:28,222 INFO [M:0;asf008:45812] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-06-15 07:46:28,222 INFO [RS:0;asf008:57332] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-06-15 07:46:28,324 INFO [RS:0;asf008:57332] snapshot.RegionServerSnapshotManager(133): Stopping RegionServerSnapshotManager gracefully. 2014-06-15 07:46:28,324 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(290): MemStoreFlusher.0 exiting 2014-06-15 07:46:28,324 INFO [M:0;asf008:45812] snapshot.RegionServerSnapshotManager(133): Stopping RegionServerSnapshotManager gracefully. 2014-06-15 07:46:28,324 INFO [RS:0;asf008:57332] flush.RegionServerFlushTableProcedureManager(112): Stopping region server flush procedure manager gracefully. 2014-06-15 07:46:28,326 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(290): MemStoreFlusher.1 exiting 2014-06-15 07:46:28,324 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.compactionChecker] hbase.Chore(93): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.compactionChecker exiting 2014-06-15 07:46:28,324 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(290): MemStoreFlusher.0 exiting 2014-06-15 07:46:28,324 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(290): MemStoreFlusher.0 exiting 2014-06-15 07:46:28,324 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.nonceCleaner] hbase.Chore(93): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.nonceCleaner exiting 2014-06-15 07:46:28,324 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.nonceCleaner] hbase.Chore(93): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.nonceCleaner exiting 2014-06-15 07:46:28,324 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.compactionChecker] hbase.Chore(93): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.compactionChecker exiting 2014-06-15 07:46:28,324 INFO [RS:1;asf008:47197] snapshot.RegionServerSnapshotManager(133): Stopping RegionServerSnapshotManager gracefully. 2014-06-15 07:46:28,326 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(290): MemStoreFlusher.1 exiting 2014-06-15 07:46:28,327 INFO [RS:1;asf008:47197] flush.RegionServerFlushTableProcedureManager(112): Stopping region server flush procedure manager gracefully. 2014-06-15 07:46:28,326 INFO [M:0;asf008:45812] flush.RegionServerFlushTableProcedureManager(112): Stopping region server flush procedure manager gracefully. 2014-06-15 07:46:28,326 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.compactionChecker] hbase.Chore(93): master/asf008.sp2.ygridcore.net/67.195.138.23:0.compactionChecker exiting 2014-06-15 07:46:28,326 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.nonceCleaner] hbase.Chore(93): master/asf008.sp2.ygridcore.net/67.195.138.23:0.nonceCleaner exiting 2014-06-15 07:46:28,325 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(290): MemStoreFlusher.1 exiting 2014-06-15 07:46:28,328 INFO [M:0;asf008:45812] regionserver.HRegionServer(849): stopping server asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,328 DEBUG [RS_CLOSE_REGION-asf008:45812-0] handler.CloseRegionHandler(119): Processing close of hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:46:28,328 DEBUG [RS_CLOSE_REGION-asf008:47197-0] handler.CloseRegionHandler(119): Processing close of testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:28,328 DEBUG [RS_CLOSE_REGION-asf008:57332-0] handler.CloseRegionHandler(119): Processing close of testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:46:28,328 DEBUG [M:0;asf008:45812] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=org.apache.hadoop.hbase.client.ConnectionUtils$1@1fe8714, zookeeper=master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:28,329 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1116): Closing testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4.: disabling compactions & flushes 2014-06-15 07:46:28,329 INFO [RS:1;asf008:47197] regionserver.HRegionServer(849): stopping server asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,329 DEBUG [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082.: disabling compactions & flushes 2014-06-15 07:46:28,329 INFO [RS:0;asf008:57332] regionserver.HRegionServer(849): stopping server asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,329 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:28,328 DEBUG [RS_CLOSE_REGION-asf008:57332-2] handler.CloseRegionHandler(119): Processing close of testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:28,328 DEBUG [RS_CLOSE_REGION-asf008:45812-0] regionserver.HRegion(1116): Closing hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff.: disabling compactions & flushes 2014-06-15 07:46:28,328 DEBUG [RS_CLOSE_REGION-asf008:47197-1] handler.CloseRegionHandler(119): Processing close of testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:28,328 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(119): Processing close of testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996.: disabling compactions & flushes 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:45812-0] regionserver.HRegion(1143): Updates disabled for region hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1116): Closing testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb.: disabling compactions & flushes 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6.: disabling compactions & flushes 2014-06-15 07:46:28,330 DEBUG [RS:0;asf008:57332] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=org.apache.hadoop.hbase.client.ConnectionUtils$1@a06e8d, zookeeper=regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:28,331 INFO [RS:0;asf008:57332] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a0004 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:46:28,329 DEBUG [RS:1;asf008:47197] catalog.CatalogTracker(207): Stopping catalog tracker CatalogTracker{connection=org.apache.hadoop.hbase.client.ConnectionUtils$1@19853c2, zookeeper=regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase, metaRegionTracker=ZooKeeperNodeTracker{node='/hbase/meta-region-server, stopped=false}, stopped=false} 2014-06-15 07:46:28,329 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:28,329 INFO [M:0;asf008:45812] regionserver.CompactSplitThread(357): Waiting for Split Thread to finish... 2014-06-15 07:46:28,331 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:45812-0] regionserver.HRegion(1696): Started memstore flush for hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff., current region memstore size 264 B 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:28,330 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1116): Closing testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b.: disabling compactions & flushes 2014-06-15 07:46:28,332 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1143): Updates disabled for region testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:46:28,332 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1696): Started memstore flush for testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b., current region memstore size 432 B 2014-06-15 07:46:28,331 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6., current region memstore size 424 B 2014-06-15 07:46:28,331 INFO [M:0;asf008:45812] regionserver.CompactSplitThread(357): Waiting for Merge Thread to finish... 2014-06-15 07:46:28,333 INFO [M:0;asf008:45812] regionserver.CompactSplitThread(357): Waiting for Large Compaction Thread to finish... 2014-06-15 07:46:28,333 INFO [M:0;asf008:45812] regionserver.CompactSplitThread(357): Waiting for Small Compaction Thread to finish... 2014-06-15 07:46:28,333 INFO [M:0;asf008:45812] regionserver.HRegionServer(1033): Waiting on 2 regions to close 2014-06-15 07:46:28,333 DEBUG [M:0;asf008:45812] regionserver.HRegionServer(1037): {1588230740=hbase:meta,,1.1588230740, f474159b9b2c9ce6028f93b01d8c97ff=hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff.} 2014-06-15 07:46:28,334 DEBUG [RS_CLOSE_META-asf008:45812-0] handler.CloseRegionHandler(119): Processing close of hbase:meta,,1.1588230740 2014-06-15 07:46:28,334 DEBUG [RS_CLOSE_META-asf008:45812-0] regionserver.HRegion(1116): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2014-06-15 07:46:28,334 DEBUG [RS_CLOSE_META-asf008:45812-0] regionserver.HRegion(1143): Updates disabled for region hbase:meta,,1.1588230740 2014-06-15 07:46:28,334 DEBUG [RS_CLOSE_META-asf008:45812-0] regionserver.HRegion(1696): Started memstore flush for hbase:meta,,1.1588230740, current region memstore size 28.28 KB 2014-06-15 07:46:28,334 INFO [StoreCloserThread-testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,335 DEBUG [RS_CLOSE_REGION-asf008:47197-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,336 INFO [StoreCloserThread-testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,336 DEBUG [RS_CLOSE_REGION-asf008:57332-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,334 INFO [StoreCloserThread-testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,334 INFO [StoreCloserThread-testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,336 DEBUG [RS_CLOSE_REGION-asf008:57332-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,337 DEBUG [RS_CLOSE_REGION-asf008:47197-1] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,337 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1225): Closed testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:28,337 INFO [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:46:28,337 INFO [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:28,337 DEBUG [RS_CLOSE_REGION-asf008:47197-1] handler.CloseRegionHandler(164): Closed testVisibilityLabelsWithDeleteColumns,,1402818378113.75dc42947d06c508dee906a344931996. 2014-06-15 07:46:28,338 DEBUG [RS_CLOSE_REGION-asf008:47197-1] handler.CloseRegionHandler(119): Processing close of testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:28,338 DEBUG [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegion(1116): Closing testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab.: disabling compactions & flushes 2014-06-15 07:46:28,338 DEBUG [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegion(1143): Updates disabled for region testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:28,338 DEBUG [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegion(1696): Started memstore flush for testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab., current region memstore size 128 B 2014-06-15 07:46:28,337 DEBUG [RS_CLOSE_REGION-asf008:47197-0] handler.CloseRegionHandler(164): Closed testDeleteColumnWithSpecificTimeStampUsingMultipleVersionsUnMatchingVisExpression,,1402818379538.35df745f74b09ded3496284489dbc8f4. 2014-06-15 07:46:28,338 DEBUG [RS_CLOSE_REGION-asf008:47197-0] handler.CloseRegionHandler(119): Processing close of testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:46:28,338 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1225): Closed testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:28,338 DEBUG [RS_CLOSE_REGION-asf008:57332-2] handler.CloseRegionHandler(164): Closed testDeleteColumnswithMultipleColumnsWithMultipleVersions,,1402818366500.d7c098d61154585ffc988b8a383845eb. 2014-06-15 07:46:28,337 DEBUG [RS_CLOSE_REGION-asf008:57332-0] handler.CloseRegionHandler(164): Closed testVisibilityLabelsWithDeleteColumnsWithMultipleVersions,,1402818352270.c383f1ec26fbb6b0da672c6525cbb082. 2014-06-15 07:46:28,338 DEBUG [RS_CLOSE_REGION-asf008:57332-2] handler.CloseRegionHandler(119): Processing close of testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:46:28,339 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1116): Closing testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2.: disabling compactions & flushes 2014-06-15 07:46:28,338 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1116): Closing testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f.: disabling compactions & flushes 2014-06-15 07:46:28,339 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1143): Updates disabled for region testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:46:28,339 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1696): Started memstore flush for testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2., current region memstore size 128 B 2014-06-15 07:46:28,339 DEBUG [RS_CLOSE_REGION-asf008:57332-0] handler.CloseRegionHandler(119): Processing close of testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:28,339 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:46:28,339 DEBUG [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1116): Closing testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db.: disabling compactions & flushes 2014-06-15 07:46:28,339 DEBUG [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:28,341 INFO [StoreCloserThread-testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,341 DEBUG [RS_CLOSE_REGION-asf008:57332-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,341 INFO [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1225): Closed testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:28,341 INFO [StoreCloserThread-testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,341 DEBUG [RS_CLOSE_REGION-asf008:57332-0] handler.CloseRegionHandler(164): Closed testDeleteFamilyLatestTimeStampWithMulipleVersionsWithoutCellVisibilityInPuts,,1402818382650.77a9376ac9bcef2c010fc93c023006db. 2014-06-15 07:46:28,341 DEBUG [RS_CLOSE_REGION-asf008:47197-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,341 DEBUG [RS_CLOSE_REGION-asf008:57332-0] handler.CloseRegionHandler(119): Processing close of testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:46:28,341 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1225): Closed testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:46:28,341 DEBUG [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1116): Closing testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00.: disabling compactions & flushes 2014-06-15 07:46:28,341 DEBUG [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:46:28,342 DEBUG [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1696): Started memstore flush for testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00., current region memstore size 416 B 2014-06-15 07:46:28,341 DEBUG [RS_CLOSE_REGION-asf008:47197-0] handler.CloseRegionHandler(164): Closed testDeleteFamilyLatestTimeStampWithMulipleVersions,,1402818350870.12ce04b663b94fe6d3dd358b67f5e74f. 2014-06-15 07:46:28,342 DEBUG [RS_CLOSE_REGION-asf008:47197-0] handler.CloseRegionHandler(119): Processing close of testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:28,342 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1116): Closing testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1.: disabling compactions & flushes 2014-06-15 07:46:28,342 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:28,342 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1., current region memstore size 288 B 2014-06-15 07:46:28,363 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,364 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,378 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,380 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,380 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=20, memsize=432, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/.tmp/d9b89257ae6349f78ad9dc7f72f0f355 2014-06-15 07:46:28,381 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741953_1129 size 5118 2014-06-15 07:46:28,382 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=23, memsize=128, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/.tmp/e968f5e90ed141b883c6960a52d3a8ff 2014-06-15 07:46:28,383 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,390 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741957_1133{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW]]} size 24213 2014-06-15 07:46:28,390 INFO [IPC Server handler 9 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741957_1133 size 24213 2014-06-15 07:46:28,392 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741954_1130{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 5231 2014-06-15 07:46:28,393 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741954_1130 size 5231 2014-06-15 07:46:28,394 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=20, memsize=424, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/.tmp/58debc89da964342981ed5aadb0ceeb5 2014-06-15 07:46:28,395 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741955_1131{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 5118 2014-06-15 07:46:28,395 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741955_1131 size 5118 2014-06-15 07:46:28,400 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,404 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,407 INFO [RS_CLOSE_REGION-asf008:45812-0] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=7, memsize=264, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/hbase/namespace/f474159b9b2c9ce6028f93b01d8c97ff/.tmp/fb46d141a8bd44f69b22484741e6b248 2014-06-15 07:46:28,408 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,408 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e968f5e90ed141b883c6960a52d3a8ff 2014-06-15 07:46:28,409 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/.tmp/d9b89257ae6349f78ad9dc7f72f0f355 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/info/d9b89257ae6349f78ad9dc7f72f0f355 2014-06-15 07:46:28,411 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/.tmp/e968f5e90ed141b883c6960a52d3a8ff as hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/info/e968f5e90ed141b883c6960a52d3a8ff 2014-06-15 07:46:28,415 INFO [IPC Server handler 3 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,421 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=18, memsize=288, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/.tmp/c4500e334c9d4ce387c77f7d06e9d4a5 2014-06-15 07:46:28,422 DEBUG [RS_CLOSE_REGION-asf008:45812-0] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/hbase/namespace/f474159b9b2c9ce6028f93b01d8c97ff/.tmp/fb46d141a8bd44f69b22484741e6b248 as hdfs://localhost:37161/user/jenkins/hbase/data/hbase/namespace/f474159b9b2c9ce6028f93b01d8c97ff/info/fb46d141a8bd44f69b22484741e6b248 2014-06-15 07:46:28,422 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDiffDeleteTypesForTheSameCellUsingMultipleVersions/08be65be204e2a7eab339d50d61bdb2b/info/d9b89257ae6349f78ad9dc7f72f0f355, entries=3, sequenceid=20, filesize=4.9 K 2014-06-15 07:46:28,423 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1847): Finished memstore flush of ~432 B/432, currentsize=0 B/0 for region testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. in 91ms, sequenceid=20, compaction requested=false 2014-06-15 07:46:28,424 INFO [StoreCloserThread-testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,424 DEBUG [RS_CLOSE_REGION-asf008:57332-1] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,425 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1225): Closed testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:46:28,425 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(164): Closed testDiffDeleteTypesForTheSameCellUsingMultipleVersions,,1402818346016.08be65be204e2a7eab339d50d61bdb2b. 2014-06-15 07:46:28,425 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(119): Processing close of testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:46:28,425 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1116): Closing testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17.: disabling compactions & flushes 2014-06-15 07:46:28,425 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:46:28,426 INFO [StoreCloserThread-testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,426 DEBUG [RS_CLOSE_REGION-asf008:57332-1] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,426 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1225): Closed testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:46:28,426 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(164): Closed testVisibilityExpressionWithNotEqualORCondition,,1402818347043.3b34b9f16dc3a089c57939b3fb3d7a17. 2014-06-15 07:46:28,427 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(119): Processing close of testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:28,427 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0.: disabling compactions & flushes 2014-06-15 07:46:28,427 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:28,427 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/.tmp/58debc89da964342981ed5aadb0ceeb5 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/info/58debc89da964342981ed5aadb0ceeb5 2014-06-15 07:46:28,428 INFO [StoreCloserThread-testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,428 DEBUG [RS_CLOSE_REGION-asf008:57332-1] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,428 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:28,428 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(164): Closed testVisibilityLabelsWithDeleteColumnExactVersion,,1402818381468.3d434c2f0b101494ab623de4b7b766f0. 2014-06-15 07:46:28,428 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(119): Processing close of testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:28,429 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1116): Closing testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09.: disabling compactions & flushes 2014-06-15 07:46:28,429 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:28,430 INFO [StoreCloserThread-testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,431 DEBUG [RS_CLOSE_REGION-asf008:57332-1] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,431 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1225): Closed testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:28,431 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(164): Closed testDeleteFamilySpecificTimeStampWithMulipleVersions,,1402818376913.a2b01ee534860115f9a4019eda29af09. 2014-06-15 07:46:28,431 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(119): Processing close of testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:28,431 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1116): Closing testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86.: disabling compactions & flushes 2014-06-15 07:46:28,431 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:28,431 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86., current region memstore size 424 B 2014-06-15 07:46:28,432 INFO [RS:0;asf008:57332] regionserver.HRegionServer(1033): Waiting on 5 regions to close 2014-06-15 07:46:28,432 INFO [RS:1;asf008:47197] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a0005 2014-06-15 07:46:28,432 DEBUG [RS:0;asf008:57332] regionserver.HRegionServer(1037): {f34d49a7897834339b9c66919f2c1ab2=testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2., 61a86c307c0fd14fc27dca26fca7cf00=testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00., d6228b4ad06925b7c71aa056548abd86=testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86., 2b637e5e3798f63e357998c82819f164=testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164., 5dc3da97048cab44677aa991904a9c5b=testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b.} 2014-06-15 07:46:28,433 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/.tmp/c4500e334c9d4ce387c77f7d06e9d4a5 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/info/c4500e334c9d4ce387c77f7d06e9d4a5 2014-06-15 07:46:28,434 INFO [RS_CLOSE_REGION-asf008:45812-0] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/hbase/namespace/f474159b9b2c9ce6028f93b01d8c97ff/info/fb46d141a8bd44f69b22484741e6b248, entries=2, sequenceid=7, filesize=4.9 K 2014-06-15 07:46:28,434 INFO [RS_CLOSE_REGION-asf008:45812-0] regionserver.HRegion(1847): Finished memstore flush of ~264 B/264, currentsize=0 B/0 for region hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. in 104ms, sequenceid=7, compaction requested=false 2014-06-15 07:46:28,435 INFO [StoreCloserThread-hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,436 DEBUG [RS_CLOSE_REGION-asf008:45812-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,436 INFO [RS_CLOSE_REGION-asf008:45812-0] regionserver.HRegion(1225): Closed hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:46:28,436 DEBUG [RS_CLOSE_REGION-asf008:45812-0] handler.CloseRegionHandler(164): Closed hbase:namespace,,1402818344808.f474159b9b2c9ce6028f93b01d8c97ff. 2014-06-15 07:46:28,439 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e968f5e90ed141b883c6960a52d3a8ff 2014-06-15 07:46:28,439 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily1/f34d49a7897834339b9c66919f2c1ab2/info/e968f5e90ed141b883c6960a52d3a8ff, entries=1, sequenceid=23, filesize=5.0 K 2014-06-15 07:46:28,439 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1847): Finished memstore flush of ~128 B/128, currentsize=0 B/0 for region testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. in 100ms, sequenceid=23, compaction requested=true 2014-06-15 07:46:28,440 INFO [StoreCloserThread-testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,440 DEBUG [RS_CLOSE_REGION-asf008:57332-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,441 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1225): Closed testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:46:28,441 DEBUG [RS_CLOSE_REGION-asf008:57332-2] handler.CloseRegionHandler(164): Closed testSpecificDeletesFollowedByDeleteFamily1,,1402818355801.f34d49a7897834339b9c66919f2c1ab2. 2014-06-15 07:46:28,441 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice/f0b89e02464e5bd1522958b344a3c7c6/info/58debc89da964342981ed5aadb0ceeb5, entries=3, sequenceid=20, filesize=4.9 K 2014-06-15 07:46:28,441 DEBUG [RS_CLOSE_REGION-asf008:57332-2] handler.CloseRegionHandler(119): Processing close of testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:46:28,441 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1847): Finished memstore flush of ~424 B/424, currentsize=0 B/0 for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. in 110ms, sequenceid=20, compaction requested=false 2014-06-15 07:46:28,441 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1116): Closing testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164.: disabling compactions & flushes 2014-06-15 07:46:28,441 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:46:28,442 INFO [StoreCloserThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,442 DEBUG [RS_CLOSE_REGION-asf008:57332-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,442 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1225): Closed testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:46:28,442 INFO [StoreCloserThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,442 DEBUG [RS_CLOSE_REGION-asf008:57332-2] handler.CloseRegionHandler(164): Closed testDeleteColumnWithLatestTimeStampUsingMultipleVersionsAfterCompaction,,1402818357020.2b637e5e3798f63e357998c82819f164. 2014-06-15 07:46:28,442 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,442 DEBUG [RS_CLOSE_REGION-asf008:57332-2] handler.CloseRegionHandler(119): Processing close of testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:46:28,442 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:28,442 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b.: disabling compactions & flushes 2014-06-15 07:46:28,442 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice,,1402818383361.f0b89e02464e5bd1522958b344a3c7c6. 2014-06-15 07:46:28,442 DEBUG [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:46:28,442 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:46:28,443 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763.: disabling compactions & flushes 2014-06-15 07:46:28,443 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:46:28,443 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1696): Started memstore flush for hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763., current region memstore size 13.14 KB 2014-06-15 07:46:28,443 INFO [StoreCloserThread-testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,443 DEBUG [RS_CLOSE_REGION-asf008:57332-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,443 INFO [RS_CLOSE_REGION-asf008:57332-2] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:46:28,443 DEBUG [RS_CLOSE_REGION-asf008:57332-2] handler.CloseRegionHandler(164): Closed testVisibilityLabelsWithDeleteFamilyVersion,,1402818354563.5dc3da97048cab44677aa991904a9c5b. 2014-06-15 07:46:28,449 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2/65bd33597f025ccf7a588fc1bed9f3d1/info/c4500e334c9d4ce387c77f7d06e9d4a5, entries=2, sequenceid=18, filesize=4.9 K 2014-06-15 07:46:28,450 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1847): Finished memstore flush of ~288 B/288, currentsize=0 B/0 for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. in 108ms, sequenceid=18, compaction requested=false 2014-06-15 07:46:28,451 INFO [StoreCloserThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,451 DEBUG [RS_CLOSE_REGION-asf008:47197-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,451 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1225): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:28,451 DEBUG [RS_CLOSE_REGION-asf008:47197-0] handler.CloseRegionHandler(164): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice2,,1402818365378.65bd33597f025ccf7a588fc1bed9f3d1. 2014-06-15 07:46:28,451 DEBUG [RS_CLOSE_REGION-asf008:47197-0] handler.CloseRegionHandler(119): Processing close of testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:28,451 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1116): Closing testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23.: disabling compactions & flushes 2014-06-15 07:46:28,451 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:28,451 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1696): Started memstore flush for testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23., current region memstore size 416 B 2014-06-15 07:46:28,461 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,462 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,465 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=57, memsize=13.1 K, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/hbase/labels/186bffbec8527bc95ede4c00649e8763/.tmp/3c99378e34f445c696f93e394e26c363 2014-06-15 07:46:28,471 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,472 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741960_1136 size 5230 2014-06-15 07:46:28,475 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=20, memsize=416, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/.tmp/5c8c7f5b2af34060b8ce74769725f25c 2014-06-15 07:46:28,479 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/hbase/labels/186bffbec8527bc95ede4c00649e8763/.tmp/3c99378e34f445c696f93e394e26c363 as hdfs://localhost:37161/user/jenkins/hbase/data/hbase/labels/186bffbec8527bc95ede4c00649e8763/f/3c99378e34f445c696f93e394e26c363 2014-06-15 07:46:28,485 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c8c7f5b2af34060b8ce74769725f25c 2014-06-15 07:46:28,487 DEBUG [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/.tmp/5c8c7f5b2af34060b8ce74769725f25c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/info/5c8c7f5b2af34060b8ce74769725f25c 2014-06-15 07:46:28,490 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,491 INFO [IPC Server handler 8 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 0 2014-06-15 07:46:28,493 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/hbase/labels/186bffbec8527bc95ede4c00649e8763/f/3c99378e34f445c696f93e394e26c363, entries=12, sequenceid=57, filesize=5.0 K 2014-06-15 07:46:28,493 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1847): Finished memstore flush of ~13.14 KB/13456, currentsize=0 B/0 for region hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. in 50ms, sequenceid=57, compaction requested=false 2014-06-15 07:46:28,494 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=20, memsize=424, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/.tmp/3e9edb3be50f477f9e9de7492dd82c58 2014-06-15 07:46:28,495 INFO [StoreCloserThread-hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763.-1] regionserver.HStore(758): Closed f 2014-06-15 07:46:28,495 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,495 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:46:28,495 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed hbase:labels,,1402818345233.186bffbec8527bc95ede4c00649e8763. 2014-06-15 07:46:28,495 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:46:28,495 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3.: disabling compactions & flushes 2014-06-15 07:46:28,496 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:46:28,496 INFO [StoreCloserThread-testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,496 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,497 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:46:28,497 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed testDeleteColumnLatestWithNoCellVisibility,,1402818348804.2828be108bd16771064395ae635dd4b3. 2014-06-15 07:46:28,497 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:28,497 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2.: disabling compactions & flushes 2014-06-15 07:46:28,497 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:28,499 INFO [StoreCloserThread-testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,499 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,499 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:28,499 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed testDeleteColumnWithLatestTimeStampUsingMultipleVersions,,1402818385570.8777fa63e8acbc235fb1bf153d3b19d2. 2014-06-15 07:46:28,499 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:28,500 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60.: disabling compactions & flushes 2014-06-15 07:46:28,500 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:28,501 INFO [StoreCloserThread-testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,501 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,501 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:28,501 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed testMultipleDeleteFamilyVersionWithDiffLabels,,1402818367610.da04879e5c51927a3089f81497b31a60. 2014-06-15 07:46:28,501 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:28,501 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5.: disabling compactions & flushes 2014-06-15 07:46:28,501 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:28,502 INFO [StoreCloserThread-testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,502 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,502 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:28,502 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed testScanAfterCompaction,,1402818368471.9f663b0e5149512e770bffee97447ec5. 2014-06-15 07:46:28,502 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:28,502 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62.: disabling compactions & flushes 2014-06-15 07:46:28,503 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:28,503 DEBUG [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/.tmp/3e9edb3be50f477f9e9de7492dd82c58 as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/info/3e9edb3be50f477f9e9de7492dd82c58 2014-06-15 07:46:28,504 INFO [StoreCloserThread-testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,504 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,504 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:28,504 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed testDeleteColumnWithLatestTimeStampWhenNoVersionMatches,,1402818375274.aadcdfde6ef8717dd8e86a135f880e62. 2014-06-15 07:46:28,504 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:28,504 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee.: disabling compactions & flushes 2014-06-15 07:46:28,504 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:28,505 INFO [StoreCloserThread-testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,505 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,505 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:28,505 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed testDeleteFamilyWithoutCellVisibilityWithMulipleVersions,,1402818384570.d0cb8a652f5700a89ec7c2b5cefb95ee. 2014-06-15 07:46:28,506 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(119): Processing close of testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:28,506 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1116): Closing testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101.: disabling compactions & flushes 2014-06-15 07:46:28,506 DEBUG [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1143): Updates disabled for region testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:28,507 INFO [StoreCloserThread-testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,507 DEBUG [RS_CLOSE_REGION-asf008:47197-2] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,507 INFO [RS_CLOSE_REGION-asf008:47197-2] regionserver.HRegion(1225): Closed testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:28,507 DEBUG [RS_CLOSE_REGION-asf008:47197-2] handler.CloseRegionHandler(164): Closed testVisibilityLabelsWithDeleteFamily,,1402818386660.cd5b5e69fe7b3e3a1af5246737707101. 2014-06-15 07:46:28,512 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1/d6228b4ad06925b7c71aa056548abd86/info/3e9edb3be50f477f9e9de7492dd82c58, entries=3, sequenceid=20, filesize=4.9 K 2014-06-15 07:46:28,513 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1847): Finished memstore flush of ~424 B/424, currentsize=0 B/0 for region testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. in 82ms, sequenceid=20, compaction requested=false 2014-06-15 07:46:28,514 INFO [StoreCloserThread-testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,514 DEBUG [RS_CLOSE_REGION-asf008:57332-1] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,514 INFO [RS_CLOSE_REGION-asf008:57332-1] regionserver.HRegion(1225): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:28,514 DEBUG [RS_CLOSE_REGION-asf008:57332-1] handler.CloseRegionHandler(164): Closed testDeleteColumnSpecificTimeStampWithMulipleVersionsDoneTwice1,,1402818363815.d6228b4ad06925b7c71aa056548abd86. 2014-06-15 07:46:28,532 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c8c7f5b2af34060b8ce74769725f25c 2014-06-15 07:46:28,532 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion/07e5ec76f887c00e779c0d44a49c3f23/info/5c8c7f5b2af34060b8ce74769725f25c, entries=3, sequenceid=20, filesize=5.1 K 2014-06-15 07:46:28,532 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1847): Finished memstore flush of ~416 B/416, currentsize=0 B/0 for region testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. in 81ms, sequenceid=20, compaction requested=false 2014-06-15 07:46:28,533 INFO [StoreCloserThread-testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,533 DEBUG [RS_CLOSE_REGION-asf008:47197-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,533 INFO [RS_CLOSE_REGION-asf008:47197-0] regionserver.HRegion(1225): Closed testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:28,534 DEBUG [RS_CLOSE_REGION-asf008:47197-0] handler.CloseRegionHandler(164): Closed testDeleteColumnAndDeleteFamilylSpecificTimeStampWithMulipleVersion,,1402818378825.07e5ec76f887c00e779c0d44a49c3f23. 2014-06-15 07:46:28,535 INFO [RS:1;asf008:47197] regionserver.HRegionServer(1033): Waiting on 1 regions to close 2014-06-15 07:46:28,535 DEBUG [RS:1;asf008:47197] regionserver.HRegionServer(1037): {4864a8248c1780569e80f2a8962d3fab=testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab.} 2014-06-15 07:46:28,552 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.periodicFlusher] hbase.Chore(93): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.periodicFlusher exiting 2014-06-15 07:46:28,552 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.logRoller] regionserver.LogRoller(120): LogRoller exiting. 2014-06-15 07:46:28,552 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.logRoller] regionserver.LogRoller(120): LogRoller exiting. 2014-06-15 07:46:28,552 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker] regionserver.Leases(148): master/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker closing leases 2014-06-15 07:46:28,552 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.logRoller] regionserver.LogRoller(120): LogRoller exiting. 2014-06-15 07:46:28,552 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker] regionserver.Leases(151): master/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker closed leases 2014-06-15 07:46:28,553 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.periodicFlusher] hbase.Chore(93): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.periodicFlusher exiting 2014-06-15 07:46:28,552 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.periodicFlusher] hbase.Chore(93): master/asf008.sp2.ygridcore.net/67.195.138.23:0.periodicFlusher exiting 2014-06-15 07:46:28,672 INFO [RS_OPEN_META-asf008:45812-0-MetaLogRoller] regionserver.LogRoller(120): LogRoller exiting. 2014-06-15 07:46:28,795 INFO [RS_CLOSE_META-asf008:45812-0] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=115, memsize=28.3 K, hasBloomFilter=false, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/.tmp/36b0b1f92d114dd984d7f4b0b4d84eda 2014-06-15 07:46:28,798 INFO [RS_CLOSE_REGION-asf008:57332-0] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=20, memsize=416, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/.tmp/cd06042e3abe402c8eff5a686726929e 2014-06-15 07:46:28,799 INFO [RS_CLOSE_REGION-asf008:47197-1] regionserver.DefaultStoreFlusher(76): Flushed, sequenceid=23, memsize=128, hasBloomFilter=true, into tmp file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/.tmp/15007a576d7948c88b5c9ffc4145299c 2014-06-15 07:46:28,810 INFO [RS_CLOSE_REGION-asf008:47197-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15007a576d7948c88b5c9ffc4145299c 2014-06-15 07:46:28,810 DEBUG [RS_CLOSE_META-asf008:45812-0] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/.tmp/36b0b1f92d114dd984d7f4b0b4d84eda as hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/info/36b0b1f92d114dd984d7f4b0b4d84eda 2014-06-15 07:46:28,810 INFO [RS_CLOSE_REGION-asf008:57332-0] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd06042e3abe402c8eff5a686726929e 2014-06-15 07:46:28,813 DEBUG [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/.tmp/cd06042e3abe402c8eff5a686726929e as hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/info/cd06042e3abe402c8eff5a686726929e 2014-06-15 07:46:28,813 DEBUG [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/.tmp/15007a576d7948c88b5c9ffc4145299c as hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/info/15007a576d7948c88b5c9ffc4145299c 2014-06-15 07:46:28,820 INFO [RS_CLOSE_META-asf008:45812-0] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/hbase/meta/1588230740/info/36b0b1f92d114dd984d7f4b0b4d84eda, entries=112, sequenceid=115, filesize=23.6 K 2014-06-15 07:46:28,820 INFO [RS_CLOSE_META-asf008:45812-0] regionserver.HRegion(1847): Finished memstore flush of ~28.28 KB/28960, currentsize=0 B/0 for region hbase:meta,,1.1588230740 in 486ms, sequenceid=115, compaction requested=false 2014-06-15 07:46:28,821 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,821 DEBUG [RS_CLOSE_META-asf008:45812-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,821 DEBUG [RS_CLOSE_META-asf008:45812-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2014-06-15 07:46:28,821 INFO [RS_CLOSE_META-asf008:45812-0] regionserver.HRegion(1225): Closed hbase:meta,,1.1588230740 2014-06-15 07:46:28,821 DEBUG [RS_CLOSE_META-asf008:45812-0] handler.CloseRegionHandler(164): Closed hbase:meta,,1.1588230740 2014-06-15 07:46:28,822 INFO [RS_CLOSE_REGION-asf008:57332-0] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd06042e3abe402c8eff5a686726929e 2014-06-15 07:46:28,822 INFO [RS_CLOSE_REGION-asf008:57332-0] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice/61a86c307c0fd14fc27dca26fca7cf00/info/cd06042e3abe402c8eff5a686726929e, entries=3, sequenceid=20, filesize=5.1 K 2014-06-15 07:46:28,822 INFO [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1847): Finished memstore flush of ~416 B/416, currentsize=0 B/0 for region testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. in 480ms, sequenceid=20, compaction requested=false 2014-06-15 07:46:28,824 INFO [StoreCloserThread-testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,824 DEBUG [RS_CLOSE_REGION-asf008:57332-0] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,824 INFO [RS_CLOSE_REGION-asf008:57332-0] regionserver.HRegion(1225): Closed testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:46:28,824 DEBUG [RS_CLOSE_REGION-asf008:57332-0] handler.CloseRegionHandler(164): Closed testDeleteFamilySpecificTimeStampWithMulipleVersionsDoneTwice,,1402818353554.61a86c307c0fd14fc27dca26fca7cf00. 2014-06-15 07:46:28,825 INFO [RS_CLOSE_REGION-asf008:47197-1] regionserver.StoreFile$Reader(1382): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15007a576d7948c88b5c9ffc4145299c 2014-06-15 07:46:28,826 INFO [RS_CLOSE_REGION-asf008:47197-1] regionserver.HStore(852): Added hdfs://localhost:37161/user/jenkins/hbase/data/default/testSpecificDeletesFollowedByDeleteFamily/4864a8248c1780569e80f2a8962d3fab/info/15007a576d7948c88b5c9ffc4145299c, entries=1, sequenceid=23, filesize=5.0 K 2014-06-15 07:46:28,826 INFO [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegion(1847): Finished memstore flush of ~128 B/128, currentsize=0 B/0 for region testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. in 488ms, sequenceid=23, compaction requested=true 2014-06-15 07:46:28,827 INFO [StoreCloserThread-testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab.-1] regionserver.HStore(758): Closed info 2014-06-15 07:46:28,828 DEBUG [RS_CLOSE_REGION-asf008:47197-1] coprocessor.CoprocessorHost(258): Stop coprocessor org.apache.hadoop.hbase.security.visibility.VisibilityController 2014-06-15 07:46:28,828 INFO [RS_CLOSE_REGION-asf008:47197-1] regionserver.HRegion(1225): Closed testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:28,828 DEBUG [RS_CLOSE_REGION-asf008:47197-1] handler.CloseRegionHandler(164): Closed testSpecificDeletesFollowedByDeleteFamily,,1402818387185.4864a8248c1780569e80f2a8962d3fab. 2014-06-15 07:46:28,833 INFO [RS:0;asf008:57332] regionserver.HRegionServer(868): stopping server asf008.sp2.ygridcore.net,57332,1402818342381; all regions closed. 2014-06-15 07:46:28,833 DEBUG [RS:0;asf008:57332] wal.FSHLog(1059): Closing WAL writer in hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,836 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 9 2014-06-15 07:46:28,837 INFO [IPC Server handler 2 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741832_1008 size 12683 2014-06-15 07:46:28,843 DEBUG [RS:0;asf008:57332] wal.FSHLog(1015): Moved 1 WAL file(s) to /user/jenkins/hbase/oldWALs 2014-06-15 07:46:28,934 INFO [M:0;asf008:45812] regionserver.HRegionServer(868): stopping server asf008.sp2.ygridcore.net,45812,1402818342029; all regions closed. 2014-06-15 07:46:28,934 DEBUG [M:0;asf008:45812] wal.FSHLog(1059): Closing WAL writer in hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,936 INFO [RS:1;asf008:47197] regionserver.HRegionServer(868): stopping server asf008.sp2.ygridcore.net,47197,1402818342492; all regions closed. 2014-06-15 07:46:28,936 DEBUG [RS:1;asf008:47197] wal.FSHLog(1059): Closing WAL writer in hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,940 INFO [IPC Server handler 0 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 9 2014-06-15 07:46:28,942 INFO [IPC Server handler 5 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741833_1009 size 21186 2014-06-15 07:46:28,943 INFO [IPC Server handler 7 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741831_1007{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-70369760-5da5-47d1-98df-a3638d877733:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-a48b8b40-66fc-40f8-bf97-a358dd85c6dd:NORMAL|RBW]]} size 21287 2014-06-15 07:46:28,944 DEBUG [M:0;asf008:45812] wal.FSHLog(1059): Closing WAL writer in hdfs://localhost:37161/user/jenkins/hbase/WALs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,944 INFO [IPC Server handler 1 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741831_1007 size 21287 2014-06-15 07:46:28,946 INFO [IPC Server handler 4 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42962 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 9 2014-06-15 07:46:28,946 INFO [IPC Server handler 6 on 37161] blockmanagement.BlockManager(2339): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33570 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-544f3538-0c32-45fd-827a-36158c74ea12:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f230c240-7ce4-42bc-baed-86a674515d5d:NORMAL|RBW]]} size 9 2014-06-15 07:46:28,947 INFO [RS:0;asf008:57332] regionserver.Leases(148): RS:0;asf008:57332 closing leases 2014-06-15 07:46:28,947 INFO [RS:0;asf008:57332] regionserver.Leases(151): RS:0;asf008:57332 closed leases 2014-06-15 07:46:28,947 INFO [RS:0;asf008:57332] regionserver.CompactSplitThread(357): Waiting for Split Thread to finish... 2014-06-15 07:46:28,947 INFO [RS:0;asf008:57332] regionserver.CompactSplitThread(357): Waiting for Merge Thread to finish... 2014-06-15 07:46:28,947 INFO [RS:0;asf008:57332] regionserver.CompactSplitThread(357): Waiting for Large Compaction Thread to finish... 2014-06-15 07:46:28,948 INFO [RS:0;asf008:57332] regionserver.CompactSplitThread(357): Waiting for Small Compaction Thread to finish... 2014-06-15 07:46:28,950 INFO [RS:0;asf008:57332] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a0007 2014-06-15 07:46:28,959 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,959 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,959 INFO [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(121): RegionServer ephemeral node deleted, processing expiration [asf008.sp2.ygridcore.net,57332,1402818342381] 2014-06-15 07:46:28,959 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-06-15 07:46:28,959 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/asf008.sp2.ygridcore.net,57332,1402818342381 2014-06-15 07:46:28,960 INFO [pool-1-thread-1-EventThread] master.ServerManager(598): Cluster shutdown set; asf008.sp2.ygridcore.net,57332,1402818342381 expired; onlineServers=2 2014-06-15 07:46:28,960 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:57332-0x1469e7d286a0001, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-06-15 07:46:28,960 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-06-15 07:46:28,961 DEBUG [M:0;asf008:45812] wal.FSHLog(1015): Moved 2 WAL file(s) to /user/jenkins/hbase/oldWALs 2014-06-15 07:46:28,961 INFO [RS:0;asf008:57332] regionserver.HRegionServer(903): stopping server asf008.sp2.ygridcore.net,57332,1402818342381; zookeeper connection closed. 2014-06-15 07:46:28,962 INFO [RS:0;asf008:57332] regionserver.HRegionServer(906): RS:0;asf008:57332 exiting 2014-06-15 07:46:28,962 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:28,962 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c4396a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(191): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c4396a 2014-06-15 07:46:28,963 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,963 DEBUG [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(92): RS node: /hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 data: PBUF?? 2014-06-15 07:46:28,964 DEBUG [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(92): RS node: /hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 data: PBUF?? 2014-06-15 07:46:28,964 INFO [M:0;asf008:45812] regionserver.Leases(148): M:0;asf008:45812 closing leases 2014-06-15 07:46:28,964 INFO [M:0;asf008:45812] regionserver.Leases(151): M:0;asf008:45812 closed leases 2014-06-15 07:46:28,967 INFO [M:0;asf008:45812] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a0008 2014-06-15 07:46:28,970 INFO [asf008.sp2.ygridcore.net,45812,1402818342029-BalancerChore] hbase.Chore(93): asf008.sp2.ygridcore.net,45812,1402818342029-BalancerChore exiting 2014-06-15 07:46:28,970 INFO [CatalogJanitor-asf008:45812] hbase.Chore(93): CatalogJanitor-asf008:45812 exiting 2014-06-15 07:46:28,970 INFO [M:0;asf008:45812] master.ServerManager(533): Waiting on regionserver(s) to go down asf008.sp2.ygridcore.net,45812,1402818342029, asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:28,970 INFO [asf008.sp2.ygridcore.net,45812,1402818342029-ClusterStatusChore] hbase.Chore(93): asf008.sp2.ygridcore.net,45812,1402818342029-ClusterStatusChore exiting 2014-06-15 07:46:29,030 INFO [asf008.sp2.ygridcore.net,45812,1402818342029.splitLogManagerTimeoutMonitor] hbase.Chore(93): asf008.sp2.ygridcore.net,45812,1402818342029.splitLogManagerTimeoutMonitor exiting 2014-06-15 07:46:29,352 DEBUG [RS:1;asf008:47197] wal.FSHLog(1015): Moved 1 WAL file(s) to /user/jenkins/hbase/oldWALs 2014-06-15 07:46:29,456 INFO [RS:1;asf008:47197] regionserver.Leases(148): RS:1;asf008:47197 closing leases 2014-06-15 07:46:29,456 INFO [RS:1;asf008:47197] regionserver.Leases(151): RS:1;asf008:47197 closed leases 2014-06-15 07:46:29,457 INFO [RS:1;asf008:47197] regionserver.CompactSplitThread(357): Waiting for Split Thread to finish... 2014-06-15 07:46:29,457 INFO [RS:1;asf008:47197] regionserver.CompactSplitThread(357): Waiting for Merge Thread to finish... 2014-06-15 07:46:29,457 INFO [RS:1;asf008:47197] regionserver.CompactSplitThread(357): Waiting for Large Compaction Thread to finish... 2014-06-15 07:46:29,457 INFO [RS:1;asf008:47197] regionserver.CompactSplitThread(357): Waiting for Small Compaction Thread to finish... 2014-06-15 07:46:29,458 INFO [RS:1;asf008:47197] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a0009 2014-06-15 07:46:29,462 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:29,462 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): regionserver:47197-0x1469e7d286a0002, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/asf008.sp2.ygridcore.net,47197,1402818342492 2014-06-15 07:46:29,462 INFO [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(121): RegionServer ephemeral node deleted, processing expiration [asf008.sp2.ygridcore.net,47197,1402818342492] 2014-06-15 07:46:29,464 INFO [pool-1-thread-1-EventThread] master.ServerManager(598): Cluster shutdown set; asf008.sp2.ygridcore.net,47197,1402818342492 expired; onlineServers=1 2014-06-15 07:46:29,464 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-06-15 07:46:29,465 INFO [RS:1;asf008:47197] regionserver.HRegionServer(903): stopping server asf008.sp2.ygridcore.net,47197,1402818342492; zookeeper connection closed. 2014-06-15 07:46:29,465 INFO [RS:1;asf008:47197] regionserver.HRegionServer(906): RS:1;asf008:47197 exiting 2014-06-15 07:46:29,465 INFO [M:0;asf008:45812] master.ServerManager(541): ZK shows there is only the master self online, exiting now 2014-06-15 07:46:29,465 DEBUG [M:0;asf008:45812] master.HMaster(883): Stopping service threads 2014-06-15 07:46:29,465 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@9f9afb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(191): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@9f9afb 2014-06-15 07:46:29,466 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(429): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:29,465 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.oldLogCleaner] hbase.Chore(93): master/asf008.sp2.ygridcore.net/67.195.138.23:0.oldLogCleaner exiting 2014-06-15 07:46:29,466 INFO [pool-1-thread-1] util.JVMClusterUtil(319): Shutdown of 1 master(s) and 2 regionserver(s) complete 2014-06-15 07:46:29,465 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.archivedHFileCleaner] hbase.Chore(93): master/asf008.sp2.ygridcore.net/67.195.138.23:0.archivedHFileCleaner exiting 2014-06-15 07:46:29,467 INFO [pool-1-thread-1] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a000b 2014-06-15 07:46:29,466 INFO [master/asf008.sp2.ygridcore.net/67.195.138.23:0.oldLogCleaner] master.ReplicationLogCleaner(137): Stopping replicationLogCleaner-0x1469e7d286a0006, quorum=localhost:53967, baseZNode=/hbase 2014-06-15 07:46:29,467 DEBUG [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(92): RS node: /hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 data: PBUF?? 2014-06-15 07:46:29,467 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2014-06-15 07:46:29,468 INFO [pool-1-thread-1] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a000c 2014-06-15 07:46:29,468 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2014-06-15 07:46:29,470 INFO [pool-1-thread-1] client.ConnectionManager$HConnectionImplementation(1670): Closing zookeeper sessionid=0x1469e7d286a000a 2014-06-15 07:46:29,470 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZKUtil(431): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2014-06-15 07:46:29,471 ERROR [master/asf008.sp2.ygridcore.net/67.195.138.23:0.oldLogCleaner] client.ConnectionManager(418): Connection not found in the list, can't delete it (connection key=HConnectionKey{properties={hbase.rpc.timeout=60000, hbase.zookeeper.property.clientPort=53967, hbase.client.pause=100, zookeeper.znode.parent=/hbase, hbase.client.retries.number=350, hbase.zookeeper.quorum=localhost}, username='jenkins'}). May be the key was modified? java.lang.Exception at org.apache.hadoop.hbase.client.ConnectionManager.deleteConnection(ConnectionManager.java:418) at org.apache.hadoop.hbase.client.ConnectionManager.deleteConnection(ConnectionManager.java:354) at org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:247) at org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.stop(ReplicationLogCleaner.java:141) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.cleanup(CleanerChore.java:276) at org.apache.hadoop.hbase.Chore.run(Chore.java:94) at java.lang.Thread.run(Thread.java:662) 2014-06-15 07:46:29,471 INFO [M:0;asf008:45812] flush.MasterFlushTableProcedureManager(74): stop: server shutting down. 2014-06-15 07:46:29,475 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/asf008.sp2.ygridcore.net,45812,1402818342029 2014-06-15 07:46:29,475 INFO [pool-1-thread-1-EventThread] zookeeper.RegionServerTracker(121): RegionServer ephemeral node deleted, processing expiration [asf008.sp2.ygridcore.net,45812,1402818342029] 2014-06-15 07:46:29,475 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): master:45812-0x1469e7d286a0000, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-06-15 07:46:29,476 INFO [M:0;asf008:45812] regionserver.HRegionServer(903): stopping server asf008.sp2.ygridcore.net,45812,1402818342029; zookeeper connection closed. 2014-06-15 07:46:29,476 WARN [pool-1-thread-1-EventThread] zookeeper.RecoverableZooKeeper(253): Possibly transient ZooKeeper, quorum=localhost:53967, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/rs 2014-06-15 07:46:29,476 INFO [M:0;asf008:45812] regionserver.HRegionServer(906): M:0;asf008:45812 exiting 2014-06-15 07:46:29,476 INFO [pool-1-thread-1-EventThread] util.RetryCounter(155): Sleeping 1000ms before retry #0... 2014-06-15 07:46:29,479 INFO [pool-1-thread-1] zookeeper.MiniZooKeeperCluster(245): Shutdown MiniZK cluster with all ZK servers 2014-06-15 07:46:29,480 WARN [pool-1-thread-1] datanode.DirectoryScanner(376): DirectoryScanner: shutdown has been called 2014-06-15 07:46:29,482 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped SelectChannelConnector@localhost:0 2014-06-15 07:46:29,491 WARN [DataNode: [[[DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa/dfs/data/data3/, [DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37161] datanode.BPServiceActor(726): BPOfferService for Block pool BP-1952897617-67.195.138.23-1402818337100 (Datanode Uuid aeb84a8a-307e-488c-b1d3-72ea0c2529e7) service to localhost/127.0.0.1:37161 interrupted 2014-06-15 07:46:29,492 WARN [DataNode: [[[DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa/dfs/data/data3/, [DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:37161] datanode.BPServiceActor(836): Ending block pool service for: Block pool BP-1952897617-67.195.138.23-1402818337100 (Datanode Uuid aeb84a8a-307e-488c-b1d3-72ea0c2529e7) service to localhost/127.0.0.1:37161 2014-06-15 07:46:29,494 WARN [pool-1-thread-1] datanode.DirectoryScanner(376): DirectoryScanner: shutdown has been called 2014-06-15 07:46:29,498 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped SelectChannelConnector@localhost:0 2014-06-15 07:46:29,552 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker] regionserver.Leases(148): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker closing leases 2014-06-15 07:46:29,553 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker] regionserver.Leases(148): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker closing leases 2014-06-15 07:46:29,553 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker] regionserver.Leases(151): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker closed leases 2014-06-15 07:46:29,553 INFO [regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker] regionserver.Leases(151): regionserver/asf008.sp2.ygridcore.net/67.195.138.23:0.leaseChecker closed leases 2014-06-15 07:46:29,578 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x18430a5-0x1469e7d286a0011, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2014-06-15 07:46:29,578 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0x19cad9d-0x1469e7d286a000e, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2014-06-15 07:46:29,578 DEBUG [ActiveMasterManager-EventThread] zookeeper.ZooKeeperWatcher(311): hconnection-0xd2bee-0x1469e7d286a0003, quorum=localhost:53967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2014-06-15 07:46:29,578 DEBUG [ActiveMasterManager-EventThread] zookeeper.ZooKeeperWatcher(400): hconnection-0xd2bee-0x1469e7d286a0003, quorum=localhost:53967, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2014-06-15 07:46:29,578 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(400): hconnection-0x18430a5-0x1469e7d286a0011, quorum=localhost:53967, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2014-06-15 07:46:29,578 DEBUG [pool-1-thread-1-EventThread] zookeeper.ZooKeeperWatcher(400): hconnection-0x19cad9d-0x1469e7d286a000e, quorum=localhost:53967, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2014-06-15 07:46:29,602 WARN [DataNode: [[[DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa/dfs/data/data1/, [DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37161] datanode.BPServiceActor(726): BPOfferService for Block pool BP-1952897617-67.195.138.23-1402818337100 (Datanode Uuid ad7bf8ed-5f16-4159-9c77-68d42e13c945) service to localhost/127.0.0.1:37161 interrupted 2014-06-15 07:46:29,602 WARN [DataNode: [[[DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa/dfs/data/data1/, [DISK]file:/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-server/target/test-data/0d9ba381-c1ee-4be6-9914-54f7ad01e42a/dfscluster_baeb3bda-c427-4299-9654-eeab477507aa/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:37161] datanode.BPServiceActor(836): Ending block pool service for: Block pool BP-1952897617-67.195.138.23-1402818337100 (Datanode Uuid ad7bf8ed-5f16-4159-9c77-68d42e13c945) service to localhost/127.0.0.1:37161 2014-06-15 07:46:29,617 WARN [org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor@1ebf4ff] blockmanagement.DecommissionManager$Monitor(78): Monitor interrupted: java.lang.InterruptedException: sleep interrupted 2014-06-15 07:46:29,641 INFO [pool-1-thread-1] log.Slf4jLog(67): Stopped SelectChannelConnector@localhost:0 2014-06-15 07:46:29,861 INFO [pool-1-thread-1] hbase.HBaseTestingUtility(958): Minicluster is down